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Preface 


The first edition of this book was written with the announced 
purpose of providing an introduction to those branches of mathe¬ 
matics with which the average analytical engineer or physicist 
should be reasonably familiar in order to carry on his own work 
p^ectively and keep abreast of current developments m his field. 
In the present edition, as m the second, although the matenal 
has been completely rewritten, the objective remains the same, 
and the various additions, deletions, and refinements have been 
made only because they seemed to contribute to the realization 
of this goal. 

Because ordinary differential equations are probably the 
most immediately useful part of postcalculus mathematics for the 
student of applied science and because the techniques of solving 
simple ordinary differential equations stem naturally from the 
techniques of calculus, the chapter on determinants and matrices 
with which the second edition began has been made a later chap¬ 
ter, and the book now begins with a chapter on ordinary differ¬ 
ential equations of the first order This is followed by two other 
chapters on differential equations which develop the subject as 
far as the solution of systems of simultaneous linear equations 
with constant coefficients Following these is a chapter on finite 
differences containing not only the usual applications to interpo¬ 
lation, numerical differentiation and integration, and the step- 
by-step solution of differential equations, but also a section on 
linear difference equations with constant coefficients paralleling 
closely the preceding development for differential equations. 
This chapter also includes a discussion of curve fitting and the 
smoothing of data, as well as the method of least squares and the 
related topic of orthogonal polynomials One innovation in the 
present edition is the introduction of the Runge-Kutta method in 
addition to Milne's method for the step-by-step solution of differ¬ 
ential equations. It is hoped that the material in this chapter will 
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provide a useful background m classical finite differences on which 
a more extensive course in numerical analysis may be based. 
The fifth chapter is devoted to the application of the foregoing 
theory to mechanical and electrical systems, and, as in the first 
two editions, the mathematical identity of the two fields is 
emphasized However, a detailed discussion of the construction 
of elertro^chanical analogies is no longer included. The next 
two chaptetft'deal, respectively, with Fourier series and integrals 
and with the Laplace transform, very much as did the correspond¬ 
ing chapters in the second edition. The chapters on separable 
partial differential equations and Bessel functions follow closely 
the development in the second edition, although many of the 
examples are new 

The matenal on determinants and matrices which formed 
Chapter 1 in the second edition now appears substantially 
expanded as two chapters which follow the material on differ¬ 
ential equations and related topics Next comes the chapter on 
vector analysis which, except for minor changes, is essentially 
the same as in the second edition Following the chapter on vector 
analysis is a new chapter devoted to an introduction to tensor 
analysis The last four chapters cover the theory of functions of a 
complex variable very much as did the corresponding chapters 
in the second edition 

The book as presently organized falls naturally into three 
major subdivisions. The first nine chapters constitute a reason¬ 
ably self-contained treatment of ordinary and partial differential 
equations and their applications The next four chapters cover 
the related areas of linear algebra, vector analysis, and tensor 
analysis; and the last four chapters cover the elementary theory 
and applications of functions of a complex variable With this 
orgamzation, the book, which contains enough material for a 
two-year postcalculus course in apphed mathematics, is well 
adapted to use as a text for any of several shorter courses 

In the third edition, as in the first two, every effort has been 
made to keep the presentation detailed and clear while at the same 
time maintaining acceptable standards of precision and accuracy. 
To achieve this, more than the usual number of worked examples 
and carefully drawn figures have been included, and in every 
development there has been a conscious attempt to make the 
transitions from step to step so clear that a student with no more 
than a good background in calculus should seldom be held up more 
than momentarily. Over 400 new exercises of varying degrees of 
difficulty have been added to the problems already in the second 
edition. These range from formal problems of a purely routine 
nature to practical applications of considerable complexity. 
Hints are included in many of the exercises, and answers to the 
odd-numbered ones are given at the end of the book As in the 
first two editions, words and phrases defined in the b ^dy of the 
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text are set in boldface, and italic type has been liberally used as 
a sign of emphasis. Theorems, corollaries, and formal definitions 
are set on wider lines than the mam body of the text, and illus¬ 
trative examples are set in type of a different size 

The indebtedness of the author to his colleagues, students, 
and former teachers is too great to catalog, and to all who have 
given help and encouragement in the preparation of this book, I 
can offer here only a most inadequate acknowledgm nt of my 
appreciation In particular, I am deeply grateful to those users 
of this book who have been kind enough to write me their impres¬ 
sions and criticisms of the first two editions and their sugges¬ 
tions for an improved third edition. Finally, I must express my 
gratitude to my wife, Ellen, and to my secretary, Mrs Jason 
Everts, who gave me invaluable assistance in proofreading the 
manuscript. 

C. R. WYLIE, JR. 




To the 
Student 


This book has been written to help you in your development as an 
applied scientist, whether engineer, physicist, chemist, or mathe¬ 
matician It contains material v^hich you will find of great use, 

' only in the technical courses you have yet to take, but also 
m your profession after graduation as long as you deal with the 
analytical aspects of your field 

I have tried to write a book which you will find not only 
useful but also easy to study from, at least as easy as a book on 
advanced mathematics can be There is a good deal of theory in 
it, for it IS the theoretical portion of a subject which is the baps 
for the nonroutine applications of tomorrow. But nowhere wiU 
you find theory for its own sake, interesting and legitimate as 
this may be to a pure mathematician Our theoretical discussions 
are designed to illuminate principles, to indicate generalizations, 
to establish limits within which a given technique may or may 
not safely be used, or to point out pitfalls into which one might 
otherwise stumble On the other hand, there are many applica¬ 
tions illustrating, with the material at hand, the usual steps m 
the solution of a physical problem, formulation, manipulation, 
and interpretation These examples are, without exception, care¬ 
fully set up and completely worked, with all but the simplest 
steps included. Study them carefully, with paper and pencil at 
hand, for they are an integral part of the text. If you do this you 
should find the exercises, though challenging, still within your 
ability to work. 

There are two minor points of notation which, when appreci¬ 
ated, should add to the ease with which you can read this book. 
In the first place, concepts and terms defined in formal definitions 
and terms defined informally in the body of the text are always 
indicated by the use of boldface type. Second, italic type is used 
in various places as a sign of emphasis, corresponding to the stress 
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which a person would place upon key words when speaking. One 
final suggestion to you in your study of this book is that you read 
each section through for the mam ideas before you concentrate on 
filling in any of the details You will probably be surprised at how 
many times a detail which seems to hold you up in one paragraph 
18 explained in the next as the discussion unfolds 

Because this book is a long one and contains material suitable 
for various courses, your teacher may begin with any of a number 
of chapters. However, the overall structure of the book is the fol¬ 
lowing; The first nine chapters are devoted to the general theme 
of ordinary and partial differential equations and related topics 
Here you will find basic analytical techniques for solving the 
equations in which physical problems must be formulated when 
continuously changing quantities are involved. Chapters 10 
through 13 deal with the somewhat related topics of linear alge¬ 
bra, vector analysis, and an introduction to generalized coordi¬ 
nates and tensor analysis. Finally, Chapters 14 through 17 
provide an introduction to the theory and applications of func¬ 
tions of a complex variable (Chapter 4, in particular, is worthy 
of note because it provides an introduction to numerical analysis, 
the modern field which deals with techniques for obtaining 
numerical answers to problems too complicated to be solved by 
exact analytic methods ) 

It has been gratifying to me to receive from time to time 
letters from students who have used this book, giving me their 
reactions to it, pointing out errors and misprints m it, and offering 
suggestions for its improvement Should you be inclined to do so, 
I should be happy to hear from you also And now good luck and 
every success. 


C R. WYLIE, JR 




Contents 


Preface v 

To the Student ix 

chapter T 

Ordinary differential equations of the first order 1 

1.1 Introduction 1 

1.2 Fundamental DefinitioiiB 2 

1.3 Separable First-order Equations 8 

1.4 Homogeneous First-order Equations 11 

1.5 Exact First-order Equations 14 

1.6 Lmear First-order Equations 19 

1.7 Applications of First-order Differential Equations 21 


chapter 2 

Linedr differential equations with 


constant coefficients 30 

2.1 The General Linear Second-order Equation 30 

2 2 The Homogeneous Linear Equation with Constant Coefficients 36 

2.3 The Nonhomogeneous Equation 42 

2 4 Particular Integrals by the Method of Variation of Parameters 49 

2.5 Equations of Higher Order 52 

2.6 Applications 55 

chapter 3 

Simultaneous linear differential equations 66 

3.1 Introduction 66 

3.2 The Reduction of a System to a Single Equation 67 

3 3 Complementary Functions and Particular Integrals for Systems 

of Equations 74 



CONTENTS 


xH 


chapter 4 

Finite difFerences 79 

4.1 The DifTerences of a Function 79 

4 2 Interpolation Formulas 90 

4 3 Numerical Integration and Differentiation 99 

4 4 The Numerical Solution of Differential P^quations 108 

4.5 Difference Kquations 117 

4.6 The Method of Least Squares 126 

chapter 5 

Mechanical ancJ electrical circuits 144 

5.1 Introduction 144 

5.2 Systems with One Degree of Freedom 144 

5 3 The Translational-mechanical System 151 

5.4 The Senes-electncal Circuit 165 

5.5 Systems with Several Degrees of Freedom 171 

chapter 6 

Fourier series and integrals 181 

6.1 Introduction 101 

6.2 The Euler Coefficients 102 

6.3 Half-range Expansions 189 

6 4 Alternative Eorms of Fourier Senes 196 

6 5 Applications 200 

6 6 Harmonic Analysis 206 

6 7 The Fourier Integral as the Limit of a Fourier Senes 211 

6 0 From the F^'ouner Integral to the Laplace Transform 222 

chapter 7 

The Laplace transformation 226 

7 1 Theoretical Preliminaries 226 

7 2 The General Method 232 

7.3 The Transforms of Special Functions 237 

7 4 Further General Theorems 242 

7 5 The Heaviside Expansion Theorems 255 

7.6 Tran.sforms of IVnodic Functions 260 

7.7 Convolution and the Duhainel Formulas 270 

chapter 8 

Partial differential equations 282 

8.1 Introduction 282 

0.2 The Derivation of Equations 282 

0.3 The D’Alembert Solution of the Wave Equation 294 

0.4 Separation of Variables 302 

0.5 Orthogonal Functions and the General I'^xpansion Problem 311 

&.6 Further Applications 320 

87 Laplace Transform Methods 338 


CONTINTS 


Kill 


chapter 9 

Bessel functions and Legendre polynomials 345 

9.1 Theoretical Preliminaries 345 

9.2 The Series Solution of Bessel's Equation 351 

9.3 Modified Bessel Func tions 357 

9 4 Equations Reducible to Bessel's Equation 363 

9.5 Identities for the Bessel Functions 365 

9.6 Orthogonality of the Bessel Functions 372 

9.7 Applications of Bessel Functions 377 

9.8 Legendre Polynomials 300 

chapter 10 

Determinants and matrices 400 

10 1 OeterniinantB 400 

10.2 Elementary Properties of Matrices 415 

10 3 Adjoints and Inverses 429 

10.4 Rank and the Equivalence of Matrices 437 

10.5 Systems of Linear Equations 444 

10 6 Matnc Differential Equations 461 

chapter 11 

Further properties of matrices 466 

11 1 Quadratic Forms 466 

11 2 The Characteristic Equation of a Matrix 477 

11 3 The Transformation of Matrices 492 

11 4 Functions of a Scpiaie Matrix 505 

115 The Cavley-Hainilton Theorem 517 

11 6 Infinite Senes of Matrices 525 

chapter 12 

Vector analysis 532 

12.1 The Algebra of Vectors 532 

12.2 Vector Functions of One Variable 545 

12.3 The Operator V 550 

12.4 Line, Surface, and Volume Integrals 559 

12.5 Integral Theorems 572 

12.6 Further Applications 585 

chapter 13 

Tensor analysis 595 

13.1 Introduction 595 

13.2 Oblique Coordinates 595 

13 3 Generalized Coordinates 605, 

13.4 Tensors 619 

13.5 Divergence and Curl 624 

13.6 Covariant Differentiation 628 



xlv 


CONTENTS 


chapter 14 

Analytic functions of a complex variable 633 

14.1 Introduction 633 

14 2 Algebraic Preliminaries 633 

M3 The Geometric Representation of Complex Numbers 636 

U4 Absolute Values 641 

14.5 Functions of a Complex Variable 644 

14 6 Analytic Functions 650 

14.7 The Elementary Functions of z 656 

14.0 Integration in the Complex Plane 663 

chapter 15 

Infinite series in the compiex plane 676 

15 1 Senes of Complex Terms 676 

15.2 Taylor’s Expansion 606 

15 3 Laurent’s Expansion 692 

chapter 16 

The theory of residues 699 

16 1 The Residue Theorem 699 

16.2 The Evaluation of Heal Definite Integrals 704 

16.3 The C'omplex Inversion Integral 711 

16 4 Stability Criteria 716 

chapter 17 

Conformai mapping 729 

17 1 The Geometrical Representation of Functions of z 729 

17 2 Conformal Mapping 732 

17 3 The Bilinear Transformation 737 

17 4 The Schwarz-ChristofTel Transformation 740 

Appendix 755 

Graefife’s Root-squaring Process 755 

Answers to odd-numbered exercises 765 


Index 


801 




CHAPTER ONE 


Ordinary 

Differential Equations 
of the First Order 

1.1 


Introduction An equation involving one or more derivatives of a function is 
called a differential equation. By a solution of a differential 
equation is meant a relation between the dependent and independ¬ 
ent variables which is free of derivatives and which, when sub- 
tituted into the given equation, reduces it to an identity The 
study of the existence, nature, and determination of solutions of 
differential equations is of fundamental importance not only to 
the pure mathematician but also to anyone engaged in the 
mathematical analysis of natural phenomena 

In general, a mathematician considers it a triumph if he is 
able to prove that a given differential equation possesses a solu¬ 
tion and if he can deduce a few of the more important properties 
of that solution A physicist or engineer, on the other hand, 
usually greatly disappointed if a sjiecihc expression for the solu¬ 
tion cannot be exhibited The usual compromise is to find some 
practical procedure by means of which the required solution can 
be approximated with satisfactory accuracy. 

Not all differential equations are of such difficulty as to 
make this necessary, however, and there are several large and 
very important classes of equations for which solutions can 
readily be found For instance, an equation such as 

IS really a differential equation, and the integral 
y = //(^) dx c 

is a solution More generally, the equation 

d^y , . 
dP = 

is a differential equation whose solution can be found by n sue- 
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cessive integrations. Except in name, the process of integration 
IS actually an example of a process for solving differential 
equations. 

In this and the following two chapters we shall consider those 
differential equations which are next in difficulty after those 
which can be solved by direct integration These equations form 
only a very small part of the class of all differential equations, 
and yet with a knowledge of them a scientist is equipped to handle 
a great variety of applications To get so much for so little is 
indeed remarkable’ 


1.2 


Fundamental definitions 

If the derivatives which appear in a differential equation are total 
derivatives, the equation is called an ordinary differential 
equation; if partial derivatives occur, the equation is called a 
partial differential equation. By the order of a differential equa¬ 
tion IS meant the order of the highest derivative which appears in 
the equation 

EXAMPLE 1 

The equation x^y" xy' -h (x* — 4)y = 0 is an ordinary differential equation of the second 
order connect mg the dependent variable y with its first and second derivatives and with the 
independent variable x 


EXAMPLE 2 

The equation - h 2 — - - H- - = 0 is a partial differential equation of the fourth order 

ax‘ dx* dy^ dy* 

At present we shall be concerned exclusively with ordinary 
differential equations 

An equation which is linear, that is, of the first degree, in the 
dependent variable and its derivatives is called a linear differential 
equation. All other equations are called nonlinear. In general, 
linear equations are much easier to solve than nonlinear ones, and 
most elementary applications involve linear equations 

EXAMPLE 3 

The equation y" -|- 4xv' -\- 2y = cos x is a linear equation of the second order The presence 
of the terms xy' and cos i docs not alter the fact that the equation is linear, becausi*, V)y defini¬ 
tion, linearity is determined solely by the way the dependent variable y and its derivatives 
enter into combination among themselves 

EXAMPLE 4 

The equation y" -f ^yy' -|- 2j/ — cos x is a nonlinear equation because of the occurrence of the 
Induct of y and one of its derivatives 
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EXAMPLE 5 

The equation y" -f- sin y — 0 is nonlinear because of the presence of sin y, which is a nonlinear 
function of y 

As illustrated by the simple equation 



and its solution 
y = i c”** dx c 

the solution of a differential equation may depend upon integrals 
which cannot be evaluated in terms of elementary functions. This 
example also illustrates the fact that a solution of a differential 
equation usually involves one or more arbitrary constants. 

A detailed treatment of the question of the maximum number 
of essential arbitrary constants that a general solution of a 
differential equation may contain or even of what is meant by 
essential constants is quite difficult * For our purposes, if an 
expression contains n arliitrary constants we shall consider them 
essential if they rannot, through formal rearrangement of the 
expression, be replaced Vjy any smaller number of constants 
Foi example, 

(i) a cos^ X b sin® i -h c cos 2x 

contains three arbitrary constants However, since 

cos 2x = cos® X — sin® x 

the expression (1) can be written in the form 

a cos® j -}- 6 sin® x c(cos® x — sm® x) =- (a + c) cos® x -|- (6 — c) sin® x 

= d cos® X + c sin® X 

where d = a c and e — b — c The fact that the three arbitrary 
con.stants a, 6, and c can be replaced by the two constants d and e 
shows that the former are not all essential. On the other hand, 
since cos® x and sin® x are linearly independentf (whereas cos® x, 
sin®x, and cos 2r are linearly dependent), it follows that there is 
no further rearrangement of the given expression that will permit 
d and e to be combined into and replaced by a single new arbi¬ 
trary constant Hence d and e are essential 

It IS frequently the case (especially with linear equations) 
that a differential equation of order n possesses solutions contain¬ 
ing n essential arbitrary constants but none containing more. 


* See, for instance, R. P Agnew, “Differential Fvquations,” 2d ed , pp 
103-105, McGraw-Hill Book Company, New York, 1960 
t See Definitions 1 and 2, Sec 10 5 
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However, there are equations such as 

+ Is/I = 0 

(which has only the single solution y = 0) and 


dx 


+ 1=0 


(which has no solutions at all) which jiossess no solutions contain¬ 
ing any arbitrary constants Moreover, there are also simple 
differential equations which possess solutions containing more 
essential parameters than the order of the equation For instance, 
it IS easy to verify that the arc of the family y = Cij^ (j S 0) 
(Fig. 1.1a) corresponding to any value of Ci can be paired with the 
arc of the family y = {x ^ 0) (Fig. 1,16) corresponding to 
any value of C 2 , to give a function which satisfies the differential 
equation 


(2) xy' = 2y 


for all values of x (Fig 1 Ic) A still more striking example of this 
sort appears in Exercise 30, where a first-order equation with a 
solution containing infinitely many essential parameters is given 
As the foregoing suggests, it is difficult, if not impossible, to 
make statements valid for all differential equations The theory 
of differential equations is essentially a body of theorems concern¬ 
ing particular classes of equations defined by such consideration^ 
as linearity, order, and continuity Typical of these is the foliow- 





Arce of different parabolas of the family y — ci* pieced together to give solutions of the differ¬ 
ential equation xy' 2y 
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mg result,* which is of fundamental importance in the study of 
the equations we shall consider in this chapter, namely, equations 
of the first order 


theorem 1 

Let {xo,Vo) he a point of the x?/-plane, let R be the rectangular region defined by 

the inequalities \x — Xo| ^ a, \y ~ y^l ^ b] let f(x,y) and Sy{x,y) = he 

single-valued and continuous at all points of R, let AT be a constant such that 
\f{x,y)\ < M at all points of R, and let h be the smaller of the numbers a and 
6 Then, on the interval \i — .ro| < h, there is a unique continuous function y 
whi(*h satisfies the equation y' = f(x,y) and which takes on the value yo when 


It IS mstuictive to reconsider Eq (2) in the light of Theorem 
1 For this equation we have f(x,y) = 2y/x, and, clearly, neither/ 
noT fy exists when x = 0 Hence, it follows from Theorem 1 that, 
over an interval containing x = 0, neither the existence nor the 
uniqueness of a solution of Eq (2) can be guaranteed Actually, 
as our earlier discussion pointed out, Eq (2) does have solutions 
which are valid for all values of x However, as Fig 1 Ic illus¬ 
trates, over any interval which contains x = 0, the solution curve 
which passes through a given point (xo,i/o), e.g , (1,1), is not 
un ^ue On the other hand, according to Theorem 1, over any 
interval which contains xo but does not contain x = 0, the 
solution curve which passes through a given point (xo,yo) is 
unique 

Almost all applications of differential equations involve 
equations which {lossess solutions containing at least one arbi¬ 
trary constant, and for such equations it is convenient to intro¬ 
duce the following definitions A solution which contains at least 
one arbitrary constant is called a general solution. A solution 
obtained from a general solution by assigning particular values to 
the arbitrary constants which appear m it is called a particular 
solution. Solutions which cannot be obtained from any general 
solution by assigning specific values to its arbitrary constants are 
called singular solutions. If a general solution has the property 
that every solution of the differential equation can be obtained 
from it by assigning suitable values to its arbitrary constants, it 
IS said to be a complete solution. A general solution can thus be 
thought of as a description of some family of particular solutions, 
and a complete solution can be thought of as a description of the 
set of all solutions of the given equation 

It IS important to note that we speak of a general solution 
and a complete solution of a differential equation and not of the 
general solution and the complete solution. If an equation has a 


* See, for matance, M Golomb and M E Shanks, "Elements of Ordmary 
Differential Equations," 2d ed., pp 63-78, McGraw-Hill Book Company, 
New York, 1965 
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general solution or a complete solution, it has many such solu¬ 
tions, and these may differ significantly in form. Moreover, in 
particular problems involving differential equations, the choice 
of which complete solution to use often has an important bearing 
on the ease with which the problem can be solved 

EXAMPLE 6 

Venfy that p — -}- 6c** is a solution of the equation p" — p' — 2p ^ 0 for all values of 

the constants a and 6 

By differentiating p, substituting into the differential equation as indicated, and then 
collecting terms on a and 6, we obtam 

(ae-* + 46e**) - (-ae"* + 2bc**) - 2(oe'* + 6e**) 

- (€-• -h €-* - 2c-*)a -b (4«>* - 2c** - 2c**)6 
-0 a-fO 6-0 

for all values of a and b Thus, y = ae~* -b be** is a general solution of y" — y' — 2y 0 In 
fact, aa we ahall see in Sec 2 2, it is a complete solution of this equation 

It IS interesting to note that, although pt — ac“* and |/i — be** also satisfy the equation 
yp*' — (yO* ■ 0 for all values of a and b, the sum 

^ !/i ~h f/2 -h 

la not a aolution of yy" — (y')* ^ 0 In fact, differentiating, Huhstitiiting, and simplifying, 
wo have 

(oc-* -b be**)(ae** + 4bc**) - (-oe-* -b 2bc**)* = 9obe* 

and this cannot vanish identically unless either a or b is zero, that is, unless the sum p consists 
of just one or the other of the two individual solutions Roughly speaking, the reason for this 
difference in behavior is that the equation y" — y' — 2y — 0 is linear, whereas the equation 
yy" ~ (y )* = o is nonlinear More precisely, as we shall see in Theorem 1, Sec 2 1, for linear 
equations in which y or one of its derivatives appears in every term, the sum of two solutions ib 
also a solution, whereas, in general, the sum of two solutions of n nonlinear equation is not a 
solution 

Occasionally it is necessary to determine a differential equa¬ 
tion of order n which has a given function containing n arbitrary 
constants as a general solution This can be done (at least theo¬ 
retically) by differentiating the given expression n times and then 
eliminating the arbitrary constants by algebraic manipulation of 
the resulting equations. 

EXAMPLE 7 

If a and b are arbitary constants, find a second-order equation which has 

(3) y “ oe* -b b cos x 
as a general solution. 

By differentiating the given expression, we find 

(4) y' — ac* — 6 sm X 

(6) p" ^ ae^ ~ b cos x 

Then, by adding and subtracting Eqs (3) and (6), we obtam 

y + y" . y - y'' 

Q ^ „- 

2c* 2 cos X 
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Substitution of these into Eq (4) gives 


v' 


1/ H- v" , 1/ - y" 

—-c*-am X 

2e* 2 COB I 


and finally 

(6) (1 -f- tan x)y‘' ~ 2y' + (1 - tan x)y - 0 

Although Eq (6), except for its obvious multiples, is the only second-order differential 
equation havmg (3) as a general solution, it is by no means the only equation of which (3) is a 
general solution For mstance, if (6) is differentiated twice more we obtain 

- ae* -1- 6 cos x 

and by comparing this with (3) we can see that the given function also satisfies the very simple 
equation 

(7) - y 

Since Eq. (7) IS of the fourth order, it presumably possesses general solutions contammg 
lour arbitrary constants, and it is easy to verify that 

y — ae‘ b cos x -H ce~’ + d sin x 
does in fact satisfy Eq (7) 


EXERCISES 


Describe each of the following equations, giving its order and telling whether it is ordinary or 
partial and linear o lonlinear 


2 y" + (a + f) cos 2x)y ■■ 0 
4 y'" ■+■ 6y" -f 4y' + y - e' 

^ d*u 

6 u — - - 

dj* dx at 



Verify that each of the following equations has the indicated solution for all values of a and b 


9 

y" — 6 y' + 9 y - 0 

y = ac** 4 bxe*' 

10 

y" -1- 4y - 0 

y “ a cos 2 x 4 6 Bin 2 x 

11 

(cos 2 x)y' -}- (2 sm 2 x)y - 2 

y ^ a cos 2 x 4 Bin 2 x 

12 

y" 4 2 y' -f 2 y - 0 

y c~*(a COB X 4 b Bin i) 

18 

2xy dy - (y^ — x) dx 

y® “ ax — X In |x| 

14 

(xy — I*) dy — y* dx 

y — oc*''* 

16 

y" + (y')’ 4 1=0 

y “ In (cos (x — a)| 4 h 

16 

dhi Bu 

dx* " at 

u — ae~** cos (3x 4 b) 

17 

^ d*u a*u 
ax’ " at’ 

u - a/(x 4 20 4 bg{x — 20 


1 V" + 3(yy + 4y - 0 
3 y" -h y' -f cos y - 0 
, d(xy') 


dx 


4- x^y — 0 


If a and b are arbitrary constants, find a differential equation of minimum order of which each 
of the following expressions is a general solution 


^8 y * ae~‘ -f- be* 

38 y - a€-« -f bte-** 
22 y - 

24 y - sin (ox + 6) 


19 y — ae~* + 6e* + cc" 

21 y — 2ax 6x* 

28 V ^ a cosh 2x b sinh 2x 
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26 Find a differential equation which has as a general solution the expression which defines 
the family of all parabolas w'hich touch the j-axis and have their axes vertical 

26 Find a differential equation which has as a general solution the expression which definet, 
the family of all lines which touch the parabols 2y ■= 

27 Verify that, for all values of the arbitrary constants o and h, both j/, — ax^ and 
I/i “ l>{x - 1)* satisfy each of the differential equations 

(i* - x)y" ~ {2x — l)y' + 2j/ « 0 and 2yy" = {y')^ 

but that y — ax^ h{i — 1)* will satisfy only the first of these equations Explain 
26 Verify that, for all values of the arbitrary constants a, 6, m, n, both i/i * ae'"' and 1/2 = 

satisfy the nonlinear differential equation y'’'y — y"y' = 0 Under what conditions, if any, 
does the sum 1 / = Vi + ?/2 ” 4 also satisfy this equation? 

29 Verify that, for all values of the arbitrary constants c\ and a, the differential equation 
xy* — 2t/ -f- 2 = 0 IS satisfied by the function 

^ I Cix* 4-1 X ^ 0 

^ “ \ cix> -hi X > 0 

Explain 

80 Verify that, for all values of the arbitrary constants {c„) (n = , ” 2, —1,0,1,2, ), 

the differential equation 

(1 — cos x)y' — (sin x)y = 0 
iB satisfied by the function 

y “ c«(l — cos x) 2n-ir ^ x < 2(n 4- l)ir 

Explain 

1.3 

Separable first-order equations 

In many cases a first-order differential equation can be reduced 
by algebraic manifiulations to the form 

(1) f{x) dx = g(y) dy 

Such an equation is said to be separable, because the variables x 
and y can be separated from each other m such a way that x 
apfiears only in the coefficient of dx and y appears only in the 
coefficient of dy An equation of this type can be solved at once 
by integration, and we have the general solution 

(2) Jfix) dx = Jg(x) dx c 

where c is an arbitrary constant of integration It must be borne 
in mind, however, that the integrals which appear in (2) may be 
impossible to evaluate in terms of elementary functions, and 
numerical or graphical integration may be required before this 
solution can be put to practical use. 

Other forms which should be recognized as being separable 
are 

(3) f(x)G{y) dx = Fix)g{y) dy 

(4) g = M(x)N{y) 
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The general solution of Eq (3) can be found by first dividing 
by the product F{x)G{y) to separate the vanables and then 
integrating: 



Similarly, a general solution of Eq. (4) can be found by first 
multiplying by dx and dividing by N{y) and then integrating: 


Clearly, the process of solving a separable equation will often 
involve division by one or more expressions In such cases the 
results are valid where the divisors arc not equal to zero, but may 
or may not be meaningful for values of the variables for which the 
division IS impossible Such values require special consideration, 
and, as we shall see in the next example, may lead us to singular 
solutions 


EXAMPLE 1 

Sol\t> the differential equation dx xy dy = j/* dj 4* ?/ dy 

It IS not immediately evident that this equation is ocparable In any case, however, the 
hoHt first step in sol' an equation of this sort is to (ollcct terms on dx and dy This gives 

(1 - y*) dx - y{l - x) dy 

which 18 of the form (3) Hence, division by the product (1 — j)(1 — y^) will separate the varia¬ 
bles and reduce the equation to the standard form (1) 

1 — I 1 — v” 

Now, multiplying by — 2 and integrating, we obtain the following equation defining y as an 
implicit function of x 


2 In |1 — j| = In |1 — y*| -|- r 

In this case, as in many problems of this sort, it ih possible to write the solution in a more 
convenient form by first combining the logarithmic terms and then taking antilogs 

I ~ ^1’ |1 - 3:|* ^ ,, 

In -->» c - - = ™ /c* 

11 - y^\ |i - v^\ 

where A:* — e' le necessarily positive Finally, clearing of fractions and eliminating the absolute 
values, we have 

(1 - x )' - ±^«(1 - y >) ^ 5^0 

The two 1 DBSibilities here can, of course, be combined into one by writing 
(1 - z)* - A(1 - y») 

''here nOw X can take on any real value, positive or negative, except 0 The solution of the differ¬ 
ential equation thus defines the family of conics 


typical members of which are shown in Fig 12 If X > 0, the solution curves are all ellipses, if 
^ 0, the solution curves are all hyperbolas 
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In most practical problemB a general solution of a differential equation is required to satisfy 
specific conditions which permit its arbitrary constants to be uniquely determined. For instance, 
in the present problem we might ask for the particular solution curve which passes through the 
point ( — ^H) Substituting these values of x and y, we then have 

“-(!)■- -- 

and the specific solution 

(6) V* - 1 + (I - 1)> 

Equation (6) defines that unique member of the family of curves (5) which passes through 
the point ( —Hoover, over any interval which contains a: - 1, there are many func¬ 
tions which satisfy the given differential equation and are such that y — when x - — 

In fact, the upper branch of any curve of the family (6) for x > 1 can be associated with the 
upper branch of the curve (6) for i ^ 1 to give a function which satisfies the given equation 
and fulfills the condition that j/ ■ when x ^ This is, of course, consistent with the 

fact that, according to Theorem 1, Sec 1 2, the uniqueness of the solution for which y — 
when X * — can be guaranteed only over an interval around x * — which does not con¬ 
tain X « 1, since y' is undefined at x — 1. 

It should be noted that, m separating variables in the given equation, it was necessary to 
divide by J — X and by 1 — y*, hence, the possibility that x — 1 and the possibility that y — ±1 
were implicitly ruled out Therefore, had we desired the particular solution curve which passed 
through any point with coordinates of the form (l,i/o), (xo,l), or (lo, — 1), we could not have 
found that curve, if it existed at all, by using the general solution and particularizing X It would 
have been neceasary, instead, to return to the differential equation and search for the required 
solution by some method other than separation of variables In this case it is obvious that the 


RGURE tJ 
Typical members 
of the solution 
family 

l(x - DVX] + v« - 1 
of the differential 
equation 

(1 - y>) dx - y(l - x)dy 
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HOMOOINIOUS FIRST-ORDH EQUATIONS 


linear equations i “ 1, 2/ * 1. and j/ — —1 all define solutions of the given differential equa¬ 
tion and, moreover, satisfy, respectively, the conditions (l,2/o), (to,1), and (a:o, — 1). None of 
these can be obtained from our general solution, although z = 1 can be included in the first 
form of It by permitting X to take on the (previously excluded) value sero Hence i/ * 1 and 
^ = -1 appear as singular solutions of the given equation 


EXERCISES 


Find a general solution of each of the following equations 


1 X dy ^ 3y dx 

5 i, dy = 2(xy x) dx 

6 j dv = (y* - 3y + 2) dx 

7 dx - xy dy ^ xy(dy — y dx) 

0 dy ^ dx 


2 3x®(l -l- y*) dx >» dy 
4 y dx ^ 2(xy -|- j) dy 
6 dx y dy x*y dy 

8 (xy* — x) dx ~ (y -F x>y) dy 
10 yy" - (y')* 


F)/id that particular solution of each of the following equations which satisfies the indicated 

condit ions' 

11 dy = j(2y dx — x dy) x ■» 1, y « 4 

12 2j dx — dy x{x dy — 2y dx) x * — 3, y = 1 

18 Is there a solution of the equation x dy = 3(y — 1) dx with the property that y “ 3 when 

X => 1 and y =» 9 when x = 2? Is there a solution of this equation with the property that 
1/ 3 when x = — 1 and y = 9 when x =• 2? Explain 

14 Find a solution of the equation (1 — x*) dy = --4xy dx with the property that y *■ 9 when 

j- ■= — 2, y = 2 hen x “ 0, and y — 0 when x 2 

16 Show that every solution of the equation y' — ky is of the form y ™ (Hint Let y be 

any solution of the given equation, and consider the derivative of the fraction y/c** ) 

16 A critical student watching his professor integrate the separable equation f{x) dx •= g{y) dy 
objected that the procedure was incorrect, since one side was integrated with respect to x 
while the other side w^as integrated with respect to y How^ would you answer the student’s 
objection ? 

17 Show that the change of dependent variable defined by the substitution f — ax -|- hy -f c 
will always transform the equation y' = flax -b by + c) into a separalile equation 

Fmd a general solution of each of the following equations 

18 y' =. ix - y)^ 19 » -2 -f + 

20 y' « (a- + _ 3)1 _ 2(x -f y - 3) 


1.4 

Homogeneous first-order equations 

If all terms in the coefficient functions M{x,y) and N(x,y) in the 
general first-order differential equation 

M(x,y) dx — N(x,y) dy 

are of the same degree in the variables x and y, then either of the 
substitutions y = ux and x = vy will reduce the equation to one 
which IS separable 

More generally, if M(Xyy) and N{x,y) have the property 
that, for all positive values of X, the substitution of \x for x and 
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\y for y converts them, respectively, into the expressions 
\^M(x,y) and \”N(x,y) 

then Eq. (1) can always be reduced to a separable equation by 
either of the substitutions y = ux and x = vy 

Functions with the property that the substitutions 

r —► Xj and y \y X > 0 

merely reproduce the original forms multiplied by X" are called 
homogeneous functions of degree n As a direct extension of this 
terminology, the differential equation (1) is said to be homo¬ 
geneous when M(xyy) and N{x,y) are homogeneous functions of 
the same degree. 


EXAMPLE 1 

Is the function 

F{x,y) - i(ln \/x* 4- y’ - In y) -}- 

homogeneous? 

To decide this question, we replace x by Xx and y by \y, getting 
F{\x,\y) “ Xx(ln \/^X*x* -f X’y* ~ In Xy) -|- 

= Xx[(ln \/X* -f y’ -f In X) — (In y -f In X)] + Xye*/«' 
- Xfxdn \/x* 4 y* - In y) -I- ye*'*'] 

“ \F{x,y) 

The given function is, therefore, homogeneous of degree 1 


(2) 


If Eq. (1), assumed now to be homogeneous, is written m the 

form 


d?/ ^ M{x,y) 
dx N{x,y) 


it is evident that the fraction on the right is a homogeneous func¬ 
tion of degree zero, since the same power of X will multiply both 
numerator and denormnator when the test substitutions x —> \x 
and y \y are made But if 
M{ \x,\y) _ M{x,y) 

N{\x,\y) N(x,y) 


it follows, assigning to the arbitrary symbol X the value 1/x if x is 
positive and the value — 1/x if x is negative, that 

I Mil,y/x) 

^ M{\x,\y) ^ 1 N{l,y/x) 

N{\r,\y) )M(-l,-y/x) 

(v(-l,-v/x) 

In either case it is clear that the result is a function of the frac¬ 
tional argument y/x. Thus, an alternative standard form for a 
homogeneous first-order differential equation is 
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Although in practice it is not necessary to reduce a homogeneous 
equation to the form (2) in order to solve it, tlie theory of the 
substitution y = ux or u — y/x is most easily devel()[ied when 
the equation is written m this form. 

Now, if 2/ = ux, then dy/dx ~ u x{du/di) Hence, under 
this substitution, Eq (2) becomes 

M ^ ^ = RM 


or 

(8) X du = [Riu) — u] dx 

If R(u) = u, Eq (2) is simply 

dy ^ H 

dx X 

and this is separable at the outset If R{u) ^ u, we can divide (3) 
by the product x[A!(w) -- ?/], getting 

dv _ dx 
R(u) ~ u r 

The variables have now Ix^en separated, and the etpiatiou can be 
in' 'grated at once l'’mally, by replacing u by its value y/x, we 
can obtain the equation defining y as a function of x 


EXAMPLE 2 

Soh'H the rqualion (z® 4 “ ^xy dt/ = 0 

P<\ ina|)(‘f t loij, this equation is hoinogenoou.s, siiiee all terms in the (oefticient of each differ¬ 
ent uU are of the second degree Hence, we substitute ij = ?/j and dij = a dz 4- r du, getting 

(z> 4 :b/*zn dx - 2x^u(u dx + i du) = 0 
or, dividing by z* and collecting terms, 

(1 +u^)dx - 2xudu = 0 
Srparnting variables, we obtain 

dx 2u du ^ 

X ~ 1 4-w* ** 

and then, by integrating, we find 

In |t 1 — In |1 4- u*! = c 
This ran be written as 


In 


1 4- 


In C 


In k where A: =» > 0 


Hciirc, lz/(l + u>)| -a k, or, replacing u by y/x and dropping absolute values, 

- ^ - ^ 

1 + {y/xy 

I inally^ clearing fractions, we have 


z» - /C(z» + v^) 
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where, from the preceding steps, it appears that K can have any real value except zero. How¬ 
ever, it 18 easy to verify by direct substitution that the function corresponding to iC =» (), 
namely, x ■> 0, is also a solution of the given equation Hence, in the general solution we have 
just obtained, K is actually unrestricted 


EXERCISES 


1 Under what conditions, if any, do you think the substitution x = vy would be more con¬ 
venient than the substitution y ™ ux? 

Find a general solution of each of the following equations 

2 {x - 3y) dx - (3i -}- 2y) dy 8 ( —x + 3y) di - (x -b y) dy 

4 2x{dx -b dy) + y{dy — 5 dx) “0 6 (x* + 2y*) dx — xy dy 


Find that particular solution of each of the follow 7 ng equations which satisfies the given 
conditions 


6 

7 

8 
9 

10 

11 

12 

18 

14 

16 


xy dx ^ x'* dy — y"^ dx 

X = 1, y » 1 

{Zy* — X*) dx — dy 

X = 1, y = 2 

(x -b y)' dx = xy dy 

X = 1, y = 1 

V dy - (2x -b y) dx 

j = 2, y “ 1 

X dy — y dx -b dx 

X “ 4, y « 3 

(x> 4- 2/») dx - 2xiy=' dy 

X =- 2, y = J 

dy 

-j- » sec y/x 4- iy/x) 
dx 

X = 2,’y = TT 

(i* -b y*) dx “ 2i‘y dij 

X = I, 7/ = 0 

(y* -b 2xy) dx + 2j* dy = 0 

X = 1, y = — 


If aB ^ hA, show that, by choosing d and D suitably, the equation 


dy ax H- /)i/ -b c 
dx Ax By -b C 


can be reduced to a homogeneous equation by the substitutions 


X =» i -b d and y ^ z -\- D 


16 Discuss Kxercise 15 in the case when ali = hA (Hint Rerall Exercise 17, Sec 1 3 ) 

Find a general solution of each of the following equations 

17 y' = (X - y 4 5)/(x -b 1 / - 1) 18 T/' = (2x -b 2v + l)/(dx 4 y - 2) 

19 C live an example of a function which is homogeneous according to our definition but is not 
homogeneous if f(\x,Xy) “ ><''f(x,y) is required to hold for all real values of X 

20 If f(x,y) IS a homogeneous function of degree n, show that 


Sf df 

X — 4- V — 
Ox dy 


nf 


Wlmt 18 the generalization of this result to functions of more than tw'o variables^ (This is 
commonly referred to as Euler’s theorem for homogeneous functions ) 


1.5 

Exact first-order equations 

Associated with each suitably differentiable function of two 
variablesthere is an expression called its total diffe .^ntial, 
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namely, 

Conversely, if the differential equation 
M(x,y) dx + N(x,y) dy = 0 
has the property that 

M(x,y) = ^ and N(x,y) = ^ 

then it can be rewritten m the form 

from which it follows that f(x,y) = is a solution for all values of 
the constant k Equations of this sort are said to be exact, since, 
as they stand, their left members arc exact differentials 

When ]\d(xjy) and N{x,y) are sufficiently simple, it is possible 
to tell by inspection whether or not there exists a function f with 
the property that 

^ = 'ix,v) and ^ ^ N(t,7j) 

In general, however, this cannot he done, and it is desirable to 
have a straightforward test to determine when a given first-order 
equation is exact Such a ciitenoii is jirovided by the following 
theorem 


TH EO RE 

I- ..d 


M 

dx 


1 

are continuous, then the differential equation 


M(x,y) dx + N(x,y) dy = 0 
i"’ exact if and only if 

dy dx 

PROOF To prove the theorem, let us assume first that the given equation is 
exact Under this assumption there exists a function / such that 


Hence, 


M = ^ 
dx 

dM d^f 
dy dy dx 


and 


AT = 


dj 


and 


dy 

m ^ d^J 

dx dx dy 


Moreover, from the familiar properties of jiartial derivatives, we know that, under 
cur hypotheses, 


dV 


d^f 


dy dx dx dy 
dl\ 

dy ~ ^ ' and the ''only if'' part of the theorem is established 


Ifc„c.e. 
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To complete the proof we must now show that, if then there is a 

dy dx 

function/such that ~ = M and ^ ^ To do this, let us first integrate M{x^y\ 

with respect to x, holding y fixed. This gives us the expression 


( 1 ) 


f(x,y) = M(x,y) dx -j- c(y) a arbitrary 


in which the integration “constant" is actually a function of y to be determined 

Clearly, ~ = M(x,y), and our proof will be complete if we can determine c{y) so 
ox 

that ^ = N{x,y) 

Now, observing that, under our hypotheses, the operations of mtegratiiip 
with respect to x and differentiating with respect to y can legitimately be inter 
changed, and recalling our supposition that 
dM ^ dN 
dy dx 

we have, from (1), 




= Nix,y) - N(a,v) + c'(y) 


Thus, ~ will equal N{x,y), as required, if c{y) is determined so that 


c'{y) = N{a,y) 


that 18 , if 


c{y) == jj N{a,y) dy h arbitrary 


We have thus shown that, if 


m 

dy 


then 

dx 


f{x,y) * dx + N{a,y) dy 

is a function such that 

^ ^ dx -f N{x,y) dy 

This establishes the “if" assertion of the theorem, and our proof is complete 


COROLLARY 1 

If the differential equation M (x,y) dx -|- N(x,y) dy = 0 is exact, then, for all 
values of k, 

^ M(i,y) dx + jj N(a,y) dy = k 
IS a solution of the equation 
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EXAMPLE 1 

:{^hov\ that the equation (2x -}- 3v — 2) dr -h (3x — 4^ *f 1) d?/ = 0 is exact, and find a general 
solution 

Applying the test provided hy Theorem 1, \\e find 

(iM d(2x + 3,1/ — 2) d.V a(3j — 4?/ -f 1) 

— = - - * 3 and —- =-- — =3 

dy dy dx dl 

Since the two partial derivatives an' equal, the equation is exact Its solution can, therefore, be 
found bv means of Corollary 1, Theori'rn 1 

j {2x T 3y — 2) dx -}- f3a - 4i/ H- \) dy k 
(x^ + 3j-jy — 2x) I + (Say — 2y^ v) 1^ ■» fc 

,a lb 

j“ + 3 j-v - 2i/^ ~ 2 j -b y = A' -h -b 3ah — 2h^ — 2a -h b = K 

Ocrasioruilly an equation which is not exact can be made 
exact by multiplying it by some simide exjiression Jn fact, it can 
be shown* that every first-order equation which possesses a 
general solution can bo made exact by multiplying it by a suitable 
factor, called an integrating factor. In general, the determination 
of an integrating factor for a given equation is very difficult 
However, as the following examjiles show, m particular cases an 
inte^ ating fac'tor can often be found by inspection 

EXAMPLE 2 

that l/(x^ -b 1 /^) IS an integrating factor for the equation (j® -|- ~ x) dx — y dy “• 0 

If the given equation is multiplied by the indicated fartoi, it (an be rewritten in the form 

(\ - —- ^dx -- dy - 0 

V -bt/v + V* 

Till (e^t juovided by Theorem 1 can be usial to sIioav that tins equation exact, and Corollary 1, 
Itworem I, (an be used to obtain the solution However, it i‘' simpler to ol'serve that the last 
can also be written 

dx -^ = 0 Qr fix _ 1 2d(ln (j’ + v*)l “ b 

-f f/* 

Hciire, integrating, 

3- — In \/-b y* = A 


EXAMPLE 3 

I Hid an mlegiating factor for the equation y dx -b (x^y^ -f x) dy = 0, and solve th(‘ equation 
bince this ecjuation can be rewritten in the form 


(?/ dx -b X dy) -f xh/^ dy ^ 0 

nd since y dx x dy = d{xy), it is natural to multiply the equation by ]/x®y®, getting 


d(xy) 

+ y dy 
xY 


t) 


See, for instance, Golomb and Shanks, op ett , pp 52-53. 
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This equation can now be integrated by inspection, and we have 



EXAMPLE 4 


Find an integrating factor for the equation x dy — y dx ^ (4j* -f y') dy, and solve the equation 
In this equation, the terms on the left seem related to 


d 



^ dy — y dx 


or, equally well, 



y dx ~ X dy 


If we pursue the first suggestion and multiply the equation by l/i“, we obtain 



This equation is still not exact, liut it is separable, and division by 4 + gives us 


divlx)^ 

4 + {y]xy 


Integrating this, we have finally 


~ Tan~‘ 
2 



V + k 


The results of the last three examples suggest the following 
observations, which are often helpful 


a If a first-order differential equation contains the combination 
.r (Lr -j- u dijf try some function of -f as an integrating 
factor 

b If a first-order differential equation contains the combination 
y dx + x dy, try some function of vy as an integrating factor 
c If a first-order differential ecjuation contains the combination 
X dy — y dx, try l/x'^ or as an integrating factor 


EXERCISES 

Find a general solution of each of the following equations 

1 (Sx’ — fijy) dx — -f- 2v) diy =“ 0 2 (?/* — \) dx (2x7/ — sin y) dy = 0 

8 (2xy -b x') dx -b {x^ -b v*) dy = 0 

4 (i \/t* -b ?/* + y) dx -b (y \/ x“ 4- i/® -b x) dy = 0 
6 y(l -b xv) dx — (r — 2y) dy =■ 0 

® + 1) rix -f- 4x7/* dy == 0 7 (xy* — y) dx -j- x(x7/ — 1) dy — 0 

0 y dx ~ dy dx + x dy 9 2y dx -b 3x dy “ dx/xy^ — dy/y* 

Solve each of the following equations by two methods 

10 2y dx -b (3i/ — 2x) dy 0 11 (x -b y) dx -b (x — y) dy = 0 

12 Vx^+ dx =" X dy — y dx 13 x dy -b y di — dx/y — dy/x 

14 Show that the arbitrary constants a and 6 which appear in the formula of Corollary b 
Theorem 1, add no generality to the solution (Hint Consider the partial derivatives wi^i 
respect to a and h of the left-hand member of the formula ) 
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16 Tf ifl an inieRrating factor of the equation M{x,y) dx + N(x,y) dy « 0, show that 0 satis¬ 
fies the partial differential equation 



1.6 


Linear first-order equations 


1 ) 


( 2 ) 


(3) 


By definition, a linear first-order differential eciuation cannot con¬ 
tain products, powers, or other nonlinear combinations of y or y' 
Hence, its most general form is 

FM + G{x)y = H(r.) 

If we divide this equation by F{x) and rename the coefficients, it 
a])pears in the more usual form 

^ + r(T)y = QM 


The presence of two terms on the left side of (1) involving, 
re, actively, dy/dv and y suggests strongly that this expression is 
in some way related to the derivative of a product, say <t>{jr)y, 
tiaving y as one factor Now the derivative of tp{x)y is 




and the left member of (1) can be made identically equal to this, 
provided we first multiply Eq (1) by 0(x), getting 

+ <)>it)P(x)y = ^{j)Q(x) 


and then make the second terms in (2) and (3) equal by choosing 
such that 




This IS a simple separable equation, any nontrivial solution of 
which will meet our requirements Hence, we can write, in 
particular, 

In |0(z)| = iP{x) dx 

d>(x) = exp [iP{x) rfx]t 

Thus, after Eq (1) is multiplied by the factor 
<t>{x) = exp \iP{x) dx] 


t The notation exp [/(x)l ifl frequently used in place of eBpenally when 
/(x) 18 a complicated expression 
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it can be wntten in the form 
lx '^J'l 

Now, the left-hand side is an exact derivative and, hence, can be 
integrated at once Moreover, the right-hand side is a function of 
X only and can, therefore, be integrated also, with at most prac¬ 
tical difhculties requiring nurneiical integration Thus we have, 
on performing these integrations, 

ij exp [/P(j-) dj] = IQ(j,) exp [JC(j-) dx] dx + c 
and finally 

(4) y = exp [ —//Ti) dx] / Q(x) exp [f/T-r) dr] dx -f-c exp f — J/^t) dt\ 

The factor exp [Jf’(r) r/j] which converts the general linear difter- 
ential equation (1) into one ’which can V>e integrated ])v ins]ie( 
tion IS, of course, another example of an integrating factor 

Equation (4) should not be remembered as a formula for the 
solution of Kep (1) A linear first-order etpiation should be solved 
by actually (‘arrying out the steps we have described 

a C'Ompute the integiating factor exp {fP(x) dx] 
b Multiply the given equation by this factor 
c Integrate both sides of the resulting equation, taking advan¬ 
tage of the fact that the integral of the left inemhcr is always 
just y times the integrating factor, 
d Solve the integrated equation for y 


EXAMPLE 1 

Pind the solution of the equation (1 -|- x^)(dy — dx) = 2xy dx for which i/ «= 1 when j" = 0 
Dividing tlip given equation by (1 -|- x*) dx and transposing, we have 


( 5 ) 


dx 


2x 


which iH a linear first-order equation In tins case r*(x) = —2j/( 1 -f- j*), thus, the inLenratinp 
factor iH 

exp ( f dx] = g-ind+x*) „ pindtx*) ' ^ 

' V; 1 -hx* / 1 4 T* 

Multiplyinp Eq (5) by this factor j^ives the equation 


1 ^ 2x 1 

1 4 X* dx ~ (1 4^ x>)“ ^ ” 1-4 

Intepratinp this, reineiiibennp that the intefi^ral of the left member is just y times the intepratinp 
factor, we have 


V 

14 


=“ Tan' ^ X 4 A 


or y « (1 -I- j>) Tan“* j 4 k{l 4- t’) 


t Note that e'"** = u for any expression u 
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To find the specific solution required, we substitute the given conditions i — 0, 7 / — 1 into 
the general solution, getting 1 — 0 -f A:. The required solution is, therefore, 

j/ » (1 + I*) Tan-> X + (1 + X') 


EXERCISES 


Find fl general solution of each of the following equations 


1 

3 

6 

7 

9 

11 

12 


X* dy d- {2xy — r + 1) dj « 0 
xy' + (1 + x)y “ e"* 

V' + !//^l - i) “ I* - a- 
y' y cot X “ sin 2j 
2x dy “ (2x ~ y) dx 


2 X dy (2y + 3x* + x^) dx 
4 (2y -f x") dx ™ X dy 

6 v' - 2y/{x + 1) -h (t + 1)« 
8 y' -h 2x1/ + x: ^ e~** 

10 y' ^ y tan i “ sec j 


1 /^ dx -I- (3xy — 4y*) (Hint Consider x as the dependent variable ) 
y" -I y’/{x — 1) *= X — 1 (Hint Consider 1 / as the dependent variable ) 


Find tlu' particular solution of each of the following equations Mdiich satisfies the indicated 
rotiditione 


18 

H 

16 

16 


(1 -f X®) df/ “ (1 -f- xy) dx X = 0, 7/ »= 1 

y’ - r'* + (1 + 2x)v = 0 X » 0, V = 2 

X dy -h (-r* — 3y) dx“0 x»=— and a: — 1, v “ ~1 
Show that the substitution z » y*'" will reduce the Bernoulli equation** 

y' -f P(j)y - Q(x)y” 


to a linear first-order equation 
Find a general solution of each of the following equations 

17 3ry' + y -h xV^ “ 0 18 dy = (xy* -|- 3xy) dx 19 y' + y ■“ x/y 

20 Prove that no extra generality in the final answer results from using mstead of 

]Ut>t as an integrating factor for the equation y -j- I*(x)y Q(x) 


1.7 

Applications of flrst-order differontial equations 

The mathematical formulation of physical problems involving 
continuously changing quantities often leads to differential equa¬ 
tions of the first order. The following examples will make clear 
how such equations arise and how they are handled 

EXAMPLE 1 

^ tank la initially filled with 1(K) gal of salt solution containing 1 lb of salt per gallon Fresh brine 
'ontaining 2 lb of salt per gallon runs into the tank at the rate of 5 gal/min, and the mixture, 
t^surned to be kept uniform by stirring, runs out at the same rate Find the amount of salt in 
^he tank at any time i, and determine how long it will take for this amount to reach 150 lb 
f-^t Q lb be the total amount of salt in solution m the tank at any time t, and let dQ be the 


• Named for the Swiss mathematician James Bernoulli (1654-1705), a 
member of a family which in little more than a century produced eight 
distinguished mathematicians 
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increase in this amount during the infinitesimal interval of time dt At any time t, the amount of 
salt per gallon of solution is therefore Q/lOO (Ib/gal) Now the change dQ m the total amount of 
salt in the tank is clearly the net gam in the interval dt due to the fresh brine running into and 
the mixture running out of the tank The rate at which salt enters the tank is 

5 (gal/min) X 2 (Ib/gal) — 10 (Ib/min) 

Hence, in the interval di the gain in salt from this source is 
10 (Ib/min) X dt (mm) — 10 dt (lb) 

Likewise, since the concentration of salt in the mixture as it leaves the tank is the same as the 
concentration Q/lOO m the tank itself, the amount of salt leaving the tank in the interval dt is 


5 (gal/mm) X ^ (Ib/gal) X dt (mm) - dt (lb) 


Therefore, 


dQ 


-(.-£) 


dt 


This equation can be written m the form 

dQ dt 


( 1 ) 


200 - Q 20 


and handled as a separable equation, or it can be WTitten 


(2) 


dQ Q 
dt "^20 


10 


and treated as a linear equation. 

Considering it as a linear equation, we must first compute the integrating factor 

. gfP dt „ gIdtIiO „ gtliO 

Multiplying Eq (2) by this factor gives 

\dt 20/ 

From this, by integration, we obtain 

- 200e'/>» + k or - 200 + 

Substituting the initial conditions f — 0, Q — 100, we find 


100 - 2fK) k or A: - -100 
Hence, Q - 200 - U)0r'‘/*« 

To find how long it will be before there is 150 lb of salt in the tank, we must find the value 
of I such that 


150 - 200 - lOOe'"**’ or H 

From this we have at once 

t 1 

-= In - = - In 2 - -0 69;j and t « Id 9 mm 

20 2 

EXAMPLE 2 

A hemispherical tank of radius H is initially filled w'lth water At the bottom of the tank there 
IB a hole of radius ; through which the water drains under the influence of gravity Find the 
depth of the water at any time t, and determine how long it w ill take the tank to dram comp) ely. 
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Let the origin be chosen at the lowest point of the tank, let y be the instantaneous depth of 
the water, and let x be the instantaneous radius of the free surface of the water (Fig 1.3). 
Then in the infinitesimal interval dt the water level will fall by the amount dy, and the resultant 
decrease in the volume of water in the tank will be 

dV - irx* dv 

This, of course, must equal the volume of water that leaves the orifice during the time dt Now 
from Torricolli’s law,* the velocity with which a liquid issues from an orifice is 

V — y/ 2gh 

where g ip the acceleration of gravity and y is the instantaneous height, or bead, of the liquid 
above the onhee In the interval dt, then, a stream of water of length y/2gy dt and of cross-sec¬ 
tion area jrr*t will emerge from the outlet The volume of this amount of water is 

dV = nT* y/2gy dt 

Hence, equating the two expressions for dV, we obtain tlie differential equation 
(M I irx* dy = —rr' y/2gy dt 

the minus sign indicating that as t increases, the depth y decreases 

Before* this equation can be solved, it is necessary that x be expre^ssed m terms of y This is 
(iihj V done through the use of the equation of the circle which describes the vertical cross section 
of the tank 

X* + (1/ - /e)* “ /e* or X* - 2yH - y* 
rning this, th(j differential equation (3) can be written 
T{2yR — j/*) dy •= -irr* y/2gy dt 

3'hiB 18 a Bimjile separable equation which can be solved without difficulty 
(2H!,H - yy‘)dv = -r'V^gdl 

- %y1‘‘ - -r> y/ig t + c 

- Ky ft)‘ ’ ti' 

figure 1,3 
A vertical plane 
see tion through 
the center of a 
licmisphencal 
tank 



* Named for the Italian mathematician and physicist Evangelista Torricelli 
(1608-1647) 

t This neglects the fact that the stream contracts near the orifice How 
much the cross section of the stream decreases depends in a very complicated 
way upon the size and shape of both the tank and the orifice and also upon 
the head However, in most practical problems reasonably accurate answers 
can be obtained by assuming that the cross section of the stream just after 
it leaves the orifice is 0 6 times the area of the orifice 



34 


ORDINARY DIFFERENTIAL EQUATIONS OF THE FIRST ORDER 


CHAP 1 


Since y R when < — 0, we find 

- c 

and thufl HRy^^ — * —r^\/2gt-\- 

This IS the equation which expresses the instantaneous depth y blb a function of t 

To find how long it will take the tank to empty, we must determine the value of t corre¬ 
sponding to 1 / * 0 

0-+ 'HsR^^ 

i if 
15 r> 

EXAMPLE 3 

The rate at which a solid substance dissolves vanes directly as the amount of undissolvcd solifl 
present in the solvent and as the difference between the instantaneous concentration and the 
saturation concentration of the substance Twenty pounds of solute is dumped into a tank con 
taming 120 lb of solvent, and at the end of 12 mm the concentration is observed to be 1 part in 
30. Find the amount of solute m solution at any time t if the saturation concentration is 1 part 
of solute to 3 parts of solvent 

If Q IS the amount of the material m solution at time i, then 20 — Q is the amount of undib 
solved material at that time and Q/12() is the corresponding concentration Hence, according to 
the given law, 

^.,(20-Q)(i-A).A(2o-Q)(40-Q) 

This IS a simple separable equation, and we have at once 

dO k 

(20 - (?)(40 - Q) ~ 

To integrate the left member it is convenient to use the method of partial fractions and 
write 

_1__ A _ _ A (40 - Q) 4- B(20 - Q) 

(20 - Q)(40 - Q) ~ 20~^'q 40 " ”"(20 - g)(40 - Q) 

This will be an identity if and only if 

1 - ^(40 - Q) + B(20 - Q) 

Setting Q — 20 and Q ■» 40, m turn, we find from this that 
A « and B - 

Hence the differential equation can be written 

20 (20 - Q ~ 40 - q) m 
and, mtegratmg, we have 

(*) - la (20 - Q) + In (40 - Q) --t+ e 

6 

When I «■ 0, the amount Q ■■ Qo of dissolved material is zero Hence 
— In20-l-ln40 — c or Ci-ln2 
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and Eq (4) can be written 

, 40 - Q k 

”2(20-Q)"6^ 

To find k wo use the fact that when « « 12, the concentration (?/120 is 3^o, or Q — 4 Hence, 
substituting these values, 

In ^%2 “ 2fc or Jfc - In % - 0 05889 
Passing to exponential form from Eq (5), in order to solve for Q, we have 
40 - Q 

-JL aa gO 00»B< 

40 - 2Q 


and finally 


40 - 40c‘’ 40(1 - "“•"O 

1 _ 2g0 ooBst 2 — f 


EXERCISES 

1 Under certain conditions it is observed that the rate at which atmospheric pressure changes 
^Mth altitude is proportional to the pressure If the pressure is 14 7 Ib/in ® at sea level and 
if il has fall(*n to one-half this value at 18,000 ft, find the formula foi the pressure at any 
height 

2 Although water is often assumed to be incompressible, it actually is not In fact, using 
peumds and feet as units, the weight of a cubic foot of water under pressure p is approxi¬ 
mately i/;(l d- kp, vhere w = 64, A* = 2 X 10"*, and p is measured from standard atmos¬ 
pheric pressure as an origin Using this information, find the pressure at any depth y below 
the hill face of the ocean At a depth of 6 miles, b> wdiat factor does the actual pressure 
exieed the pressure computed on tlie assumption that water is incomjiressible? 

3 Radium disintegrates at a rate proportional to the amount of radium instantaneously 
present If one-half of any given amount of radium will disappear m 1,590 years, what 
fraction will disintegrate during the fust century? during the tenth century? 

4 According to Lambert’s law of absorption,* when light passes through a transparent me- 
diiiiTi, the amount absorbed by any thin layei of the material is proportional to the amount 
incident on that layer and to the thickness of the layer In his deep-sea explorations off 
Bcrnuida, Beebe observed that at a depth of 50 ft the intensity of illumination was 10 can- 
dlea/ft^, and that at 250 ft it had fallen to 0 2 eandle/ft* Find the law connecting intensity 
^Mth depth in this case 

B It is a fact of common experience that, when a rope is wound around a rough cylinder, a 
small force at one end can resist a riiiich larger force at the other Quantitatively, it is 
found that, throughout the portion of the rope in contact with the cylinder, the change in 
tension per unit length is proportional to the tension, the proportionality constant being 
the coefhcient of friction between the rope and the cylinder divided by the radius of the 
i^^yhnder Assuming a coefficient of friction of 0 35, how many times must a rope be snubbed 
around a post 1 ft in diameter in order that a man holding one end can resist a force 200 
times greater than he can exert? 

6 When ethyl acetate m dilute aqueous solution is heated in the presence of a small amount of 
acid, it decomposes according to the following equation 

CH.COOCaHs + H 2 O CH.COOH -f- C,H.OH 

ethyl acetate water acetic acid ethyl alcohol 


* Named for the German mathematician and astronomer Johann Heinrich 
Lambert (1728- 1777) 
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Since this reaction takes place in dilute solution, the quantity of water present is so great 
that the loss of the small amount which combines with the ethyl acetate produces no appre¬ 
ciable change m the total amount Hence, of the reacting substances only the ethyl acetate 
suffers a measurable change in concentration A chemical reaction of this sort, in which the 
concentration of only one reacting substance changes, is called a first-order reaction. It ih 
a law of physical chemistry that the rate at which a substance is being used up, i e , trans¬ 
formed, in a first-order reaction is proportional to the amount of that substance instan¬ 
taneously present If the initial concentration of ethyl acetate is Co, find the expression for 
its instantaneous concentration at any time i 

7 In some chemical reactions where two substances combine to form a third, the amount of 
each of the reacting substances changes appreciably In such cases it is observed that the 
rate at which the resulting compound is formed is proportional to the product of the on- 
transformed amounts of the two reacting substances If two substances combine m the 
ratio 1 2, by weight, to form a third substance, and if it is observed that, 10 mm after 
10 grams of the first substance and 20 grains of the second arc mixed, the amount of the 
product which has been formed is 5 grams, find an expression for the amount of the product 
present at any time 

8 Work Exercise 7 given that, instead of 10 grams of the first substance and 20 grams of tlic 
second, 20 grams of each substance arc mixed 

9 A mothball loses mass by evaporation at a rate proportional to its instantaneous surfact 
area If half its moss is lost in 100 days, how long will it take its radius to decrease to half 
its initial valued How long will it be before the mothball disappears completely? 

10 When a volatile substance is placed in a sealed container, molecules leave its surface at a 
rate proportional to the area of the surface and return at a rate proportional to the amount 
which has evaporated If a volatile material is spread evenly to a depth h over the bottom 
of a closed box, find the depth of the material at any time Under what conditions, if anv, 
will all the material eventually evaporate? 

11 A rapidly rotating flywheel, after power is shut off, "coasts" to rest under the retardinp 
influence of a friction torque which is proportional to the instantaneous angular velocity w 
If the moment of inertia of the flywheel is 7 and if its initial velocity is ojo, find its instan¬ 
taneous angular velocity os a function of time How long will it take the flywheel to come 
to rest^ (Hmt Use Newton’s law in torsional form, 


Moment of inertia X angular acceleration »= torque 


12 


to set up the differential equation describing the motion ) 

The friction torque acting to slow down a flywheel is actually not proportional to the first 
power of the angular velocity at all speeds As a more realistic example than Exercise 11, 
suppose that a flywheel of moment of inertia 7 — 75 Ib-ft sec* coasts to rest from an initial 
speed of 1,000 rad/min under the mfluence of a retarding torque T estimated to be the 
following 



0 < w < 100 rad/mm 
100 < w < 1,000 rad/sec 


Fmd w as a function of t, and determine how long it will take the flywheel to come to rest 
18 A body weighmg w lb falls from rest under the influence of gravity and a retarding force 
due to air resistance, assumed to be proportional to the velocity Find the equations expres- 
sing the velocity of fall and the distance fallen, as functions of t, and verify that these 
reduce to the ideal laws 


V ^ gt and 


B - 
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when the coefficient of air resistance approaches zero. (Hint. Use Newton’s law, 

3fa8S X acceleration « force 

to set up the differential equation which describes the motion ) 

14 Work Exercise 13, given that the retarding force due to air resistance is proportional to the 
square of the velocity of fall 

16 A body falls from rest from a height so great that the fact that the force of gravity varies 
inversely as the square of the distance from the center of the earth cannot be neglected 
Find the equations expressing the velocity of fall and the distance fallen as functions of t in 
the ideal case in which air resistance is neglected [Hint dv/dt (dv/dy)(dy/dt) ^ v(dv/dy) ] 

16 thider the conditions of Exercise 15, determine the minimum milml velocity with which a 
body must be projected upward if it is to leave the earth and never return 

17 A particle of mass m moves along the z-axis under the influence of a force which is directed 
toward the origin and proportional to the distance of the particle from the origin If the 
body starts from rest at the point where x = xo, find the equations that express its velocity 
and its distance from the origin as functions of I (Note the hint to Exercise 15 ) 

18 A tank contains 100 gal of brine m which 50 lb of salt is dissolved Brine containing 2 lb/gal 
of salt runs into the tank at the rate of 3 gal/min, and the mixture, assumed to be kept 
uniform by Stirling, runs out of the tank at the rate of 2 gal/min Assuming the tank 
sulhciently large to avoid overflow, find the amount of salt in the tank as a function of t 

19 Work Exercise 18 with the rates of influx and efflux interchanged 

20 Work Example 3 given that the saturation concentration is 1 part of solute to 12 parts of 
solvent 

21 Work Example T uven that the saturation concentration is 1 part of solute to 6 parts of 
solvent 

22 Work Example 3, with concentration defined as the ratio of solute to solution instead of 
solute to solvent 

23 According to Newton’s law of cooling, the rate at which the temperature of a body decreases 
18 proportional to the difference between the instantaneous temperature of the body and the 
temperature of the surrounding medium If a body whose temperature is initially 100“C 
IS allowed to cool in air which remains at the constant temperature 2()'’C, and if it is ob¬ 
served that m 10 nun the body has cooled to 00“, find the tempeiature of the body as a 
function of time 

24 A tank and its contents weigh 100 lb The average beat capacity of the system is 0 5 Btu/ 
(lb)(°F) The liquid in the tank is heated by an mimersion heater which delivers 100 
Btu/min Heat is lost from the system at a rate proportional to the difference between the 
temperature of the system, assumed constant throughout at any instant, and the tempera¬ 
ture of the surrounding air, the proportionality constant being 2 Btu/(min) (°F) If the air 
temperature remains constant at 70'" and if the initial temperature of the tank and its 
contents is 55®, find the temperature of the tank at any time 

26 According to Fourier’s law of heat conduction, the amount of heat m Btu per unit time 
flowing through an area is proportional to the area and to the temperature gradient, m 
degrees per unit length, normal to the area On the basis of this law, obtain a formula for 
the amount of heat lost per unit time from 1 ft* of furnace wall k ft thick, if the temperature 
m the furnace is To and if the air temperature outside the furnace is Tj What is the tem¬ 
perature distribution through the furnace wall? 

26 Using Fourier's law of heat conduction, obtain a formula for the amount of heat lost per unit 
time from I ft of pipe of radius ro carrying steam at temperature 7'o if the pipe is covered 
with w m of insulation, the outer surface of which remams at the constant temperature T i 
What IS the temperature distribution through the insulation? 

27 The inner and outer surfaces of a hollow sphere are mamtained at the respective tempera¬ 
tures To and Tj If the inner and outer radu of the spherical shell are ro and ri, find the 
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29 


SO 

31 

82 


38 


84 

86 

36 

87 


86 


80 


amount of heat lost from the sphere per unit time What is the temperature distribution 
through the shell? 

When a condenser of capacity C is being charged through a resistance R by a battery which 
supplies a constant voltage E, the instantaneous charge Q on the condenser satisfies the 
differential equation 


R 


dt 


-h- 


E 


Find Q as a function of t if the condenser is initially uncharged How long will it be before 
the condenser is half charged? 

When a switch is closed in a circuit containing a resistance R, an inductance L, and a 
battery which supplies a constant voltage E, the current t builds up at a rate defined by 
the relation 

dt 

L- Rt ^ E 
dt 


Find i os a function of i How long will it take t to reach one-half of its final value? 

In Exercise 28, find Q as a function of t if the battery is replaced by a generator which 
supplies an alternating voltage equal to Eo sin wt 

In Exercise 29, find i os a function of t if the battery is replaced by a generator winch sup¬ 
plies an alternating voltage equal to Eo cos ut What is tlie phasi* difTerence belween the 
imiiresseii voltage and the resultant current after the current has b( cn flowing a long time? 
A vertical cylindnoHl tank of radius r is filled with liquid to a depth A When the tank is 
rotated about its axis, centrifugal force tends to drive the liquid outward from the center 
of the tank Under steady conditions of rotation with constant angular velocity w, find the 
equation of the curve in which the free surface of the liquid is intersected by a plane through 
the axis of tlie eylmder, assuming the tank to be sufhciently deep that no liquid is spilled 
over the edge 

A weight ir is to be supported by a column having the shape of a solid of revolution If 
the material of the column weighs p Ib/ft’, and if the radius of the upper base of the column 
IS to be To, determine how the radius of the column should vary in order that at all cross 
sections the load per unit area wdl be the same 

Work Example 2 if the tank has the shape of an inverted right circular cone of radius R 
and height k. 

Work Example 2 if the tank has the shape of a vertical right circular cylinder of radius R 
and height h and if, in addition to a hole of radius r m the bottom, there is also a hole of 
radius r m the side at a distance of A/2 above the base 

A cylindrical tank is I ft long and has semicircular end sections of radius r ft The tank is 
placed with its axis horizontal and is initially filled with water How long will it take the 
tank to drain tlirough a hole of area a ft* in the bottom of the tank? 

A vertical cylindrical tank of radius r and height A has a narrow crack of width w running 
vertically from top to bottom If the tank is initially filled with water and allowed to drain 
through the crack under the influence of gravity, find the instantaneous depth of the water 
in the tank as a function of t How long will it take the tank to empity? (Hint First imagine 
the crack to be a senes of adjacent orifices, and integrate to find the total efflux from the 
crack m the infinitesimal interval dt ) 

Water flows into a vertical cylindrical tank of cross-section area A ft* at the rate of Q 
ft*/min At the same time the w^ater flows out under the influence of gravity through a hole 
of area a ft* m the base of the tank If the water la initially h ft deep, find the instantaneous 
depth as a function of L 

If two families of curves have the property that each member of either family cuts every 
member of the otlier family at right angles, the curves of either family are said t be 
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orthogonal trajectories of tiio rurvos of the other family. Find the orthogonal Imjoctories of 
the (‘iirve.s of the family -f- v® = kx [Hint Show that, at a general point (j,v), the slope 
of that curve of the given family w’hich passes through that point is given by the formula 


v' 


-2j=‘ - f 
2xv~ 


nnrl then find the curvf'S whose slopes are given by the negative reciprocal of this expression ] 
40 Find tlu orthogonal trajectories of the curves of the family 

_ j2 = 



CHAPTER TWO 


Linear Differential 
Equations 
with Constant 
Coefficients 


2.1 

The general linear second-order equation 

The general linear drfTerential e(]uation of the second order can be 
written m the standard form 

(1) v" -f /Tj)?/' -h Q{'x)y = /f(:r) 

where P, Q, and R are known functions Clearly, no loSwS of 
neralily results from taking the coefficient of y" to be unity, 
since this can always be accomplished by division Because of the 
presence of the term R(x), which is unlike the other terms in that 
it does not contain the dependent variable y or any of its deriva¬ 
tives, KIcp (1) IS said 1.0 be nonhomogeneous. If R{x) is identically 
zero, we have the so-called homogeneous equation* 

(2) 2 /" -f -f Q(x)y - 0 

In general, neither Eq (1) nor Kq (2) can be solved in terms 
of know n functions The theory associated with such special cases 
as have been studied at length is, for the most part, very difhcult 
At this stage we shall consider in detail only the simple, though 
highly important, case in which F{x) and Q(x) are constants 
However, both as an illustration of how certain properties of the 
solutions of a differential equation can be established even though 
the form of those solutions is unknown and also because w^e shall 
have need of the results thenivselves, we shall begin by proving 
three fundamental theorems pertaining to the solutions of the 
general equations (1) and (2) 


• It 18 regrettable that in describing linear equations of all orders the word 
homogeneous should be used m a manner totally unlike its use in describing 
equations of the first order (S«*c 1 4) The usage is universal, however, and 
must be accepted 
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theorem 1 

If yi and 2/a are any solutions of the homogeneous equation 
y” -h P{x)y' + Q{x)y = 0 

then 2 /j = cij/i + caj/s, where ci and Ca are arbitrary constants, is also a solution. 

PROOF To establish this theorem, it is necessary only to substitute the 
expression for y% into the given differential equation and venfy that it is satisfied 

vi -h P{^)y'z + Q{x)yi = (ci2/i + Ca2/a)" + P{x){ciyi + Ca^a)' 

I- Q{x){ciyi + CiVi) 
= (ci2/i' + cm) + P{x){ciy[ + cai/j) 

+ Q{x){ciyi -f- Cai/a) 
= \yi -b P{x)y\ + Q{x)yi]ci 

-f IVi + P{x)y2 + Q(x)i/2]ca 

= 0 Cl -h 0 Ca = 0 

where the coefficients of Cj and ca vanish identically becaqse, by hypothesis, both 
Vi and y 2 are solutions of the homogeneous equation (2) 

Theorem 1 assures us that, if we have two solutions of the 
he "ogeneous equation (2), then we can obtain infinitely many 
other solutions simply by forming arbitrary linear combinations 
of these two However, it leaves completely unanswered the 
important question of whether or not all solutions of (2) can be 
obtained from the pair (.i/ni/a) m this fashion To decide this point 
we need the stronger result contained in the next theorem 

THEOREM 2 

If yi and 1/2 are two solutions of the homogeneous equation 
y" + P(x)y' + Q(x)y = 0 

for which 

^/ = 1/11/2 V2I/1 ^ 0 

2/1 2/2 

and if jP(x) dx exists, then there exist constants Ci and C 2 such that any solution 
2/3 of the homogeneous equation can be expressed in the form y^ = ciy\ + Ciy 2 

PROOF To prove this theorem, it is convenient to show first that any pair of 
solutions of Eq (2), say 1 /, and y,, satisfies the relation 

(3) W{y„y,) = y(y[ - y,y[ = fc., exp [-//-‘(z) dx] 

where k,, is a suitable constant To establish this, we begin with the hypothesis 

t The symbol W(yi,yi) is customarily used to denote this combination of two 
functions, in honor of Hocn^ Wronsky (1778-1853), Polish poet anti mathe¬ 
matician who was one of the first to study determinants ot this type. Such 
determmants are usually referred to as Wronskions. 
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that both yt and are solutions of (2) and, hence, that 
y[' + P(i')y[ d- Q{x)y^ -= 0 
y]' + P{x)yj + Q{x)yj = 0 

If the first of these equations is multiplied by ;/j and subtracted from y^ times the 
second, we obtain 

(4) {y.ijj - 'ihy[') -I- P{x){y,y[ - y,y[) = 0 


Now, 


dx 


iyd/'Z + y'y'j) ~ (v,'//.' H- y^A') 
- (ihA/ - yd/:) 


Hence, Eq (4) can be written 

dW{y.,y,) 


dx 


4- PCr)lE(/A,y,) = 0 


This is a very simple, separable differential eipiation whose solution can be 
written down immediately 

W{yr,yj) = k,jexi)[-~jP(x) dx\\ 

where is an integration constant. This establishes the relation (d), which is 
usually known as Abel’s identity, after the Norwegian mathematician Niels Abel 
(1802-1829) 

Now consider the tw^o pairs of solutions (vaj/i) and {ih^yi), wdiere y^ is any 
solution wliatsoover of the homogeneous equation (2) Appl 3 nng Abel's identity 
(d) to each of these pairs in turn, we have 

y^y'i - yiy[ = exp [-/P(x) dx] 
yiy 2 - yiy[ = Aajexp [-/P(t) dx] 

In general it is possible to solve these two simultaneous equations for y-^, getting 

3 == <^xp [- JP (j-) ffj] 

^ ywi - yiAi 


If we now apply Abel's identity to the denominator of the last exiiression, we 
obtain 

kx 2 exj) [-/P(x) dx] 


Interpreting k^ 2 /k\i as Ci and — as ca, we have thus succeeded in exhibiting 

any solution as a linear combination c\y\ -j- Co^/a of the two particular solutions 
y\ and ^ 2 , provided only that the expression 

y\yz - 2 / 22/1 = W{yi,y2) 

by w’hich we had to divide m order to solve for y^, does not vanish. Theorem 2 is 
thus established. 


t Since an exponential function can never vaniah, it follows that wherever 
/P(jr) dx exists, the Wronskian of y, and y^ is either never zero or identically 
zero, ac(;’ordiiig as 0 or A:,j = 0 
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From Theorem 2 jt is clear that to find a complete solution 
of Kq (2) we must first find two particular solutions that have a 
nonvamshing Wronskian, or in otliei words are Imi'iirly independ¬ 
ent (Fxernse 6), and then we must form a linear combination of 
these solutions with arbitrary coefficients We must icmember, 
however, that, although there are infinitely many jiairs of par¬ 
ticular solutions ./i and y>i which can be used as a ba^is for con- 
stiucting a coni])lete solution of Kq (2), neither Theorem 1 nor 
Theorem 2 telK ns how fo find them In fact there is no general 
method for solving Imi (2)* and the only procedure aiiplicablc in 
all cases is one winch permits us to deterniiiu second, independ¬ 
ent solution wlien one solution is known 

To dinnOo]) this pioi eduie, let us suppose t hat yi.{x) ^ 0 is a 
solution of Imi (2), and hU us attempt to find a function 0 (j-) with 
the propiM'ty that 4>[i)yx{\) i'^ also a solution of (2) Substituting 
y ^ 0(r)//i(r) into Kq (2), w^e have 

(//] ^ "1" “b -f- 1/100 "b Qi^)(yi<t>) 

— [Vi 4- -b f2(r)Vil0 "b [2y\ 4* =~- 0 

i\ow, the coefficient of 0 in the last expression is ident-icallv zero, 
since, by hypothesis, y/j is a solution of lOc] (2) Hence, the last 
ecpnition will be satisfied jirovided 0 is chosen such that 

+ [2//I “b b*(r)y/ij0' -- 0 

d4ns IS a simple separable equation in 0', and have 

~A' I “ ** 

* L //■ J 

oi, integiating, 

In 10'I 4 2 In |y/i| 4- //'(r) dr = In [cl 

Hence, combining the logarithms and taking antilogs, 

, ( exj) [-f/"(0 (/.r] 

0 ^ - " 0 - 

Ih^ 

Integrating again, we find 
J '/l' 

iroin which wc ohtain, for all values of c and k, the .solution 
^Uli/iCO = evi(i) / ^ -q-r + ^1/iW 

J V1 t r / 

Since this contains twm aibitrary constants, it is actually a com¬ 
plete solution, i>rovided that the two jiartieular solutions from 

• The nearest thing to a general solution procedure is the use of infinite 
senes, described in Sec 9 1 
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which it is constructed, namely, 

»■<*>/ 

have a nonvanishing Wronskian. It is not difficult to show that 
this IB always the case, although we shall leave the proof as an 
exercise. 


EXAMPLE 1 

Find a oompleto solution of the equation j'y" -f xy' — 4?/ ‘= 0 , given that y « j® is one solution 
Substituting the assumed solution y = into the given differential equation, we have 

i®(20 -f 4x0' 4” x*0") -f j(2j0 + T*0') - 4y®0 »= 0 

or, simplifying, 

j0" -}- 50' “ 0 


Separating variables, we obtain 



^ dr « 0 
X 


Then, integrating, we get 


In | 0 '| 'f 5 111 jxj = In 14 or 0 ' = - 
and finally, integrating again, 


0 - “ T-, + ^ 

4x* 

The complete solution is, therefore, 

y = j *0 «*= - ~ -t- /cx® 

4x® 

The solution of the nonhoniogericous equation (1) is leased on 
the following theorem 


THEOREM 3 

If y IS any solution of the nonhoinogeneous equation 
V" + r{r)y' -f Q{x)y = I{(.r) 

and if ciyi -{■ a complete solution of the homogeneous equation obtained 

fioni this by deleting the term R{x), then y = CiT/i + C 2 y 2 -h T is a complete 
solution of the noiihomogerieous equation 

PROOF Let y be any .solution wdiatsoever of the nonhomogeneous equation (1) 
Then 

y" 4- P{r)y' -f- Q{x)y = R(x) 
and, similarly, since Y is also a solution of (1), 

Y" -h P(x)Y' -h Q{x)Y - R{x) 
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If we subtract the last two equations, we obtain 

_ r-) + _ Y') + Q(x)(y - K) = 0 

or (y - Y)" + F{x)(y - Y)' + Q{x){y ->0=0 

Thus the quantity y — V satisfies the homogeneous equation (2) and, hence, by 
Theorem 2, must be expressible in the form 

y — Y ^ Ci 2 /i + C 21/2 

provided that W(y\^y 2 ) ^ 0; that is, provided that ciyi -h C 2 I /2 is a complete soiu- 
tion of (2), as we assumed Therefore, transposing, 

y = Ciyi + C 21/2 + Y 

Since y was any solution of the nonhomogeneous equation (1), Theorem 3 is thus 
established 

The term Y, which can be any solution of (1) no matter how 
special, IS called a particular integral of the nonhomogeneous 
equation The expression r^yi -h C 2 I/ 2 , which is a complete solution 
of the homogeneous equation corresponding to (1), is called the 
complementary function of the nonhomogeneous equation The 
steps to be carried out in solving an equation of the form (1) can 
be summarized as follows 

a Delete the term R(x) from the given equation, and then find 
two . tutions of the resulting homogeneous equation which 
have a nonvanishing Wronskian Then combine these to form 
the complementary function cii/i -f C 2 I /2 of the given equation, 
b Find one particular solution Y of the nonhomogeneous equa¬ 
tion itself 

c Add the complementary function Ciyi + C 2 i /2 found in step a to 
the particular integral Y found in step b, to obtain the complete 
solution y = ri?/i + C 21/2 + Y of the given equation. 

In the following sections we shall investigate how these 
theoretical steps can be carried out when P(x) and Q{x) are 
constants; that is, when we have the so-called linear differential 
equation with constant coefficients. 


EXERCISES 

Using the one solution indicated, find a complete solution of each of the following equations 


!/" + V “ 0 

y” + 3y' -h 2i/ » 0 

(1 - 2x)y" + 2y' -f (2x - 3)y - 0 

(2x - x^)y" T 2(i - l)y' - 2y ~ 0 


x'y" -f- 


yi - sin X 
yi - 
yi “ e* 

Vi ^ X — I 
7/1 - X 

f — (x* -}- 2x)y' -h (x -h 2)v *• 0 1/1 = x 

Verify that each of the following equations has the indicated solutions, and in each case 
construct two different complete solutions. 

® y" - 1 / “ 0 yi “ e* Vi » C-* 

^ y" — 3y' -h 2y - 0 yj - c* y* * e** 

^ y'^ + y ■■ 0 j/i — Bin (x -f r/4) yi " sin (x — ir/4) 

y" — 2(cot 2x)y' - 0 2/1 ■■ sin* x 2/2 — cos* x 
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5 Show that the two solutions 

j /• exp f-/P(3:) dj] ^ 

Vi and i/i /--- dx 

J J/i* 

of the equation y" -f P(x)y' + Q(.x)y “ 0 have a nonvanishinR Wronskian 
4 If the Wronskian of two functions is different from zero at every point of an interval, show 
that there is no point of the interval at which the functions are Biniultaneously zero 

6 If the Wronskian of two functions is different from zero at every point of an interval, sho^\ 
that there is no point of the interval at which cither function has a repeated zero 

6 Show that, if two differentlahle functions are Iinearlj deiicndent, thoir Wronskian is equal 
to zero 

7 Show that the conviTSe of the assertion of K>ereiHe 6 is false Hint Consider, for — sc < 
X < », the followiuK pair of functions 

( — x’ — oc < X ^ 0 



8 Show that the converse of the assertion of Exorcise (i is true over anv interval on w Inch the 
two functions have no common zero 

9 Show’ that, if the Wronskian of two functions is different from zero at every point of an 
interval, then, betw een any tw'o consecutive zeios of either of the functions in that interval 
there is exactly one zeio of the other function [Hint I-iCt ?/i and pj be the two functions, 
let a and h he coiiseeutive zeros of pi, apply Rolle's theorem to the quotient t/i/i/z over th( 
interval {a,h), and note the contradiction unless ?/. « (I at wsome point between a and h I 

10 K> plain how Abel’s identity can be used to find a second solution of the equation y" 4 
Pix)y' + Q(x)y — wdien one solution is known Illustiate the method by applying it to 
parts a and b of Exercise 1 


2.2 

The homogeneous linear equation with constant coefficients 


( 1 ) 


When P{x) and Q(x) aie constants, the general linear second- 
order differential equation can be wntten in the standard form 

(fy" -h hy' 4- n/ = /(t) 


A second standard form which is oft(\ encountered is based 
upon the so-called operator notation. In this, the symbol of 
differentiation d/dx is replaced by D, so that, by definition, 



As an immediate extension, the second derivative, which, of 
course, is obtained by a repetition of the process of differentiation, 
IS wntten 

DiDy) - Dhj 


t Just 08 the prime notation, y\ y", , may in specific instances indicate 

derivatives with respect to x, (, or any other independent variable, so the 
operator notation, Dy, D*y, , may also indicate derivative^ with 

respect to an indepenacnt variable other than x, depending on the c atext 
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Similarly, 0 = D(D»y) = D*y 
= D{D>y) = D<y 

Evidently, positive integral powers of D (which are the only ones 
we have defined) obey the usual laws of exponents 

If due care is taken to see that vanables are not moved across 
the sign of differentiation by a careless interchange of the order of 
factors containing variable coefficients, the operator D can be 
handled in many respects as though it were a simple algebraic 
(juantity J'or instance, after defining (aD^ d- bl) + c)/(j) to 
mean aIPf{x) -(- bDf(x) -j- cf{x), we have, for the polynomial 
operator 117)^ — 107d — 8 and its factort^d equivalents, 

(:i7)2 - lOD ~ 8)x2 = 3(2) - l()(2x) - 8(x2) = 6 - 20x - 8.r= 
(37d -E 2)(7) - 4)x2 - (37) + 2)(2x - 4 x 2 ) 

= (6 - 24x) 4- (4x - 8x2) = (3 - 20x - 8x2 
(7) - 4) (3D + 2)x2 = (D - 4)(()x + 2x2) 

= (b -f 4x) - (24r 4 8x2) = (5 _ 20x - 8x2 

whicl llustratcs how algebraically equivalent forms of an oper¬ 
ator yield identical results when ajiplied to the same function 
Using the operator D, we can evidently write Eq (1) in the 
alternative standard form 
1 ^’) (aD2 4 - 6D 4 - c)y - f(x) 

Many writers base the solution of Eq (1) upon the oper¬ 
ational properties of the symbol 7) However, we shall postpone 
all operational methods until the chapter on the Laplace trans¬ 
formation, where opeiational calculus can be develojied easily 
and efficiently in its proper setting 

Following the theory of the last section, we first attempt to 
find a complete solution of the homogeneous equation 

2 ) ay" -j- by' cy 0 

or 

2^) (aD2 + 6D 4 r)y - 0 

obtained from (1) or (la) by deleting/(x) In searching for par¬ 
ticular solutions of (2), it is natural to try 

y = 

where m is a constant to be determined, because all denvatives of 
this function are alike except for a numerical coefficient Substi¬ 
tuting into Eq (2) and then factoring from every term, we 
have 


e^(am^ hm c) = 0 
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as the condition to be satisfied if y = is to be a solution. Since 
e”** can never be zero, it is thus necessary that 

(3) om* -h hm -b c = 0 

This purely algebraic equation is known as the characteristic or 
auxiliary equation of either Eq (1) or Eq (2) In practice it is 
obtained not by substituting y = e"** into the given differential 
equation and then simplifying, but rather by substituting m* for 
z/", m for and 1 for y in the given equation, or, still more simply, 
by equating to zero the operational coefficient of y and then 
letting D play the role of m 

aD^ hD c = 0 

The characteristic equation is a simple quadratic which will 
in general be satisfied by two values of m 

— h ± \/b^ — 4ac 

Using these values, say mi and two solutions 
= e"*** and y^ = 

can be constructed. From this y ir, according to Theorem 1, 
Sec 2 1, an infinite family of solutions 

(4) y = ciyi -b C 2 I /2 = -b € 26 ”^^ 

can be formed Moreover, by Theorem 2, Sec 2 1, if the Wronskian 
of these solutions is different from zero, then (4) is a complete 
solution of Eq (2), 1 e, it contains all possible solutions of the 
homogeneous equation Accordingly, we compute 

fE(yi,j/2) = y\y2 ~ yiy'i = 

= {m2 — 

Since can never vanish, it is clear that a complete solution 

of Eq (2) IS always gwen by (4), except in the special case when 
TMi = m 2 and the Wronskian vanishes identically. 

EXAMPLE 1 

Find a complete solution of the differential equation y" -\- 7y’ +12^ “0 
The characteristic equation in this case is 

m* + 7m + 12 “ 0 

and its roots are 

mi — —3 and mi — —4 
Since these values of m are different, a complete solution is 
V - cie’** -f- 

EXAMPLE 2 

Find a complete solution of the equation y" -f 2y' -f — 0 
The characteristic equation in this case is 


m* H- 2m 5 " 0 
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and its rootB are 

mi — — 1 -f 2i and ma “ —1 — 2t 
Since these are distinct, a complete solution is 

j/ >■ -f- 

Although the last expression is undeniably a complete solu¬ 
tion of the given equation, it is unsatisfactory for many practical 
purposes because it involves imaginary exponentials, which are 
awkward to handle and are not tabulated It is, therefore, a 
mattei of considerable importance to construct a more convenient 
complete solution m the case m which mj and are conjugate 
complex quantities 

To do this, let us suppose that 

Till — p -j- uj and m 2 = p — iq 

so that a complete solution as first constructed is 

By factoring out this can be written as 

y = -f 

Now the expression in parentheses can be simplified by using the 
Euler formulas (Sec 14 7) 

f*® = cos 6 + 1 sin 6 
— cos B — i sin 6 

taking 6 =■ qj The result of these substitutions is 
y =L fp^[fi(cos qjc -f- i sin qx) -|- C 2 (<‘os qx — i sin ^r)] 

= c^'^[(ci -|- C 2 ) cos qi -f- i{ci — C 2 ) sin (/x] 

If we now define two new arbitrary constants by the equations 
A = Cl -h C 2 and B = ?(ci — r 2 ) 

the complete solution can finally be put in the purely real form 
y = e^^{A cos qx A~ B sm qx) 

Of course, it is not difficult to verify directly that both 
yi = cos qx and = cp"* sm qx 

are particular solutions of the homogeneous equation (2) For a 
completely satisfactory derivation this should now be done, since 
we do not yet know that our formal treatment of complex 
exponentials, as though they obeyed the same laws as real 
exponentials, is justified 

EXAMPLE 2 (confinued) 

Applying the preceding reasoning to Example 2, it is clear that p = — 1 and ^ — 2 Hence, the 
*^oniplpte solution can be written 


y »= c ‘(A COB 2z 4- ^ sin 2i) 
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When the characteristic equation has equal roots, the two 
independent solutions normally ansiuR from the substitution of 
y = e’”* become identical, and, as we pointed out above, we do 
not have an adequate basis for constructing a complete solution 
To find a second, independent solution in this case we use the 
method developed in the last section 

Let the differential equation in question be 

y" - 2ry' + r^y = 0 
so that its characteristic equation 
— 2 rm -f- = 0 


has the repeated root mi = r Then yi - is one solution, and, 
from Eq. (5), Sec. 2 1, a second independent solution is given by 

yij 


g-//»(r)clr A 

„ -- dx = 6"* / 


2 /r 


p2rx 


Thus, in the exceptional cane in which the characteristic equation has 
equal roots^ a complete solution of Eq (2) is 


y = CiC"*** -b C 2 xe’"»* 


EXAMPLE 3 

Find a complete solution of the equation {D^ -f- -f ^)y = 0 
In this case the characteristic equation 

m* + 6m 4- 9 ■* 0 

is a perfect square, with roots mi “ mj “» —3 Hence, by our last remark, a complete solution 
of the given equation is 

y * cie“** -f cjie'** 

The complete process for solving the homogeneous equation 
(2) in all possible cases is summarized in Table 2 1 


table 2 1 


Differential equation ay" 4 by' 4 cy *» 0 or (a/)* -f bD 4“ c)y = 0 
Characteristic equation am* -|- bm -f c — 0 or aD^ 4“ bD -|- c ™ 0 


Nature of the roots of 
the characteristic 
equation 

Condition on the 
coefficients of the 
characteristic equation 

Complete solution of the 
differential equation 

Real and unequal 

mj mj 

6 * — 4oc > 0 

y =» cic*"!* + czc"*** 

Real and equal 

mi * mj 

6 * - 4oc = 0 

y B CiC"i* 4 CjJC"*'* 

Conjugate complex 
mi • p + tq 

6 * — 4ac < 0 

y * e^’{A cos qx B sin qx) 

1 

1 

1 
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In particular applications, the two arbitrary constants in the 
complete solution must usually be determined to fit initial condi¬ 
tions on xj and v^ or their equivalent. The following examples will 
clarify the procedure 

EXAMPLE 4 

Tind tlie solution of the equation y" — Ay' Ay = 0 for which y = 8 and i/' » 4 when i »= 0 
The charactenstie equation of the differential equation is 

w® — Am -f 4 = 0 

Itt' rootf^ are ^ VI 2 — 2, hence, a eoinpiete solution is 
7 / = CiC^ T 
fU (liherentiat mg this, we hnd 

y' — (2ci T T 2c>}ie^' 

SuhstituLing the gnim data into th«> ('quations for y and //', respectively, we have 
d = fj 4 = 2ci d- c-i 

Ih IK e, C) = 8, r-^ = —2, and the recjuired solution ih 
7 / = 37- 2te’^< 

EXAMPLE 5 

loud the solution of the ^ ,nation (4/)* f \{\D -f 17)i/ = 0 for winch // = 1 whi'ii I = 0 and 
' -- 0 w lien 1 = TT 

III ihi.s case the (haracteristie equation is 
Am^ -f lOrri + 17 = 0 

aiio from ilh roots, m = —2 ± obtain the complete solution 

/ t A 

U ~ I A cos ^ T H sin j 

•''ulistitiitmR the Riven eonditions into this equation, we hnd 

1 = A and U = < or H => 0 

Heiur , the required solution is 

t 

y = f~ cos 


EXERCISES 

1 hat IS the diffcTenee between Dy and yD? 

2 \enfv that 


-f l)iIP + 2) sin 3x - (D^ -h 2)(D + 1) sin Sx = (D* A -\- 21) -h 2) sin Hx 

2 Is (1) A x)(J) A- 2j)f^ = {D -}- 2t)(I) -b x)e^? Explain 
4 \Miat nieaniiiR, if any, do you think can be assigned to />“7 D~'’^ 1)~^'^ 

I ind 11 eoinpiete solution of each of the following equations 

® y" -f Lf' - 27/ = 0 6 dy" + Gy' -f ?/ = 0 

y" ~ Gy » () 8 y" - Gy' = 0 

® (4/>* + 4D d- 1 ) 1 / = 0 10 («D* - 12/; + A)y - 0 

U lOv" d- 6y' -b i/ - 0 12 y" A- liVy' A- 26y - 0 
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Find the solution of each of the following equations which satisfies the given conditions 


18 

14 

16 

16 

17 

16 

19 

20 


y" -1- 3v' - 4j/ » 0 

y = 4, v' “2 when a: » 0 

y" -h 4j/ » 0 

y = 2, y' “ 6 when 1 = 0 

y" - 4i/ » 0 

y “ 1, y' = —1 when x = 0 

25y'' A 20y' A 0 

y ■« y' = 0 when x «= 0 

(D* -h 6/) 9)y - 0 

V “ ff) y' “ 3 when X =» 0 

{D* A 2D A b)y - 0 

y =• 1 when I ■= 0, y' = 0 when x = ir 

(D> A 2D A 5)y - 0 

y — 1 when x — 0, y “ 0 when x * ir 

a Verify by direct substitution that yi = cos qx and ]/2 = am qx are solutiona of 

the equation 


y" - 2py' -f (p* -I- (/*)[/ = 0 

b Verify that these solutions have a nonvanishmg Wronskian 

21 Show that, for k ^ 0, both y A cos {kx B) and y =» 6^ sin {kx -|- H) are complete 
solutions of the equation y" -|- k*y = 0 

22 Show that, for k 9 ^ i), y A cosh kx B sinh kx is a complete solution of the equation 
y" - k*y » 0 

23 Show that y “ cosh qx A B sinh qx) is a complete solution of the equation ay" -h 

W -f cj/ = 0, when the roots of the characteristic equation are p ± q, q 9 ^ 0 

24 If the roots of its characteristic equation are real, show that no nontrivial solution of the 
equation aij" A hy' A ty = i) can have more than one real zero 

26 If the (’haracteristic equation of the differential equation ay" + hy' -1 cy “ 0 has distinct 
roots Wi and m 2 , show that 


C"*!* — pHtjjr 

V “- 

fTl[ — m2 

18 a particular solution of the equation Can we take the limit of this expression as m 2 —* mi 
and obtain a second solution of the differential equation when its characteristic equation 
has equal roots? 


2.3 

The nonhomogeneous equation 

In the last section we learned how to solve the homogeneous equa¬ 
tion ay" -h by' + cy = 0, and with this knowledge we can now 
obtain the complementary function of the nonhomogeneous 
equation 

(1) ay" -f by' 4- cy = f(x) 

However, we must also have a particular integral, 1 e , a particular 
solution, of Eq (1), before we can construct its complete solution, 
namely, 

y = complementary function -f particular integral 

Various procedures are available for the determination of par¬ 
ticular solutions of Eq. (1), some applicable no matter what/(a;) 
may be, others useful only when f(x) belongs to some suitably 
specialuBed clas.s of functions It should be borne in mind, h^ v- 
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ever, that, in applying Theorem 3, Sec 2 1, the important thing 
IS not how we obtain a particular solution of Eq (1) but merely 
that we have one such solution Any method, from outright 
guessing to the most sophisticated theoretical technique, is 
legitimate, provided that it leads to a solution that can be checked 
in (1) In this section w^e shall introduce (he so-called method of 
undetermined coefficients, which appears initially to be based on 
little more than guesswT^rk, but wdiich is readily formalized nto 
a well-dehned piocedure applicable to a well-defined and very 
important (lass of cases 

To illustrate the method, suppose that we wish to hnd a 
jiarticular integral of the ecpiation 

(2) y" + 4^' + 3^ = 

Since dilTerentiating an exponential of the form e** merely repro¬ 
duces the function ivith, at most, a change in its numern^al 
coefficient, it is natuial to “guess” that it may be possible to 
determine A so that 

1 =- Ae^- 

will be a solution of (2) To check this, we substitute Y — AeA^ 
into t^ ' given equation, getting 

4j\(>2x qj ~ 

which will he an identity if and only if A - Thus, the required 
particiilai integral is 

r = 

Now supjiose that the right-hand member of (2) had been 
5 sm 2.r (luided by our previous success w^e might j)eiha]is be led 
to try 

} - A sin 2 1 

as a particular integral Substituting this to check whether oi not 
it can be a solution, we obtain 

--4A sm 2i -h 8A cos 2 c -f 3A sm 2jr = 5 sin 2x 
— A sin 2x + SA cos 2 x = 5 sin 2 x 

and this cannot be an identity unless, simultaneously, A = —5 
and A = 0, which is absurd The difhculty here, of course, is that 
differentiating sm 2i introduced the new function cos 2 j, which 
must also be eliminated identically from the equation resulting 
from the substitution of E - A sm2( Since the one arbitrary 
constant A cannot satisfy two independent conditions, it is clear 
that we must arrange to incorporate two arbitrary constants m 
oui tentative choice for V This is easily done by assuming 


} = A sin 2x -h B cos 2x 
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which contains the necessary second parameter, yet cannot intro¬ 
duce any further new functions, since it already is a linear com¬ 
bination of all the independent terms that can be obtained from 
sm 2x by repeated differentiation The actual determination of 
A and B is a simple matter, for substitution into the given differ¬ 
ential equation yields 

( — 4 A sin 2x — 4B cos 2 j) -h 4 (2A cos 2t — 2B sin 2x) 

-h 3(A sin 2x B cos 2x) = 5 sin 2x 
( — A — SB) sin 2x 4- (8X — fi) cos 2x = 5 sin 2x 
and for this to be an identity requires that 
-A - SB ^ 5 and 8^ - 5 = 0 

from which we find immediately that A = — Ha and B = “Ha 
Hence, finally, 

y _ sm 2a- -{- 8 cos 2x 

With these illustiations m mind we arc now in a position to 
describe more precisely the use of the method of undetermined 
coefficients for finding particulai integrals 

rvle 1 If/(x) IS a function for which icpeatod differentiation yields only 
a finite number of linciarly independent expressions, then, m 
general, a particular integral Y for the nonhomogeneous equation 
ay'^ -f by' -j- cy = f(x) can be found by 

a Assuming 1' to be an arbitral}^ linear combination of all the 
linearly independent terms which arise from /(x) by repeated 
differentiation 

b Substituting Y into the given differential equation 
c Determining the arbitrary constants in Y m such a way that 
the resulting equation is identically satisfied 

The class of functions/(x) possessing only a finite number of 
linearly independent derivatives consists of the simple functions 

k 

x" (n a positive integer) 

cos kx 
sm kx 

and any others obtainable from these by a finite number of addi¬ 
tions, subtractions, and multiplications If/(x) possesses infinitely 
many independent denvatives, as is the case, for instance, with 
the simple function 1/x, it is occasionally convenient to assume 
for Y an infinite senes whose terms are the respective derivatives 
of fix) each multiplied by an arbitrary constant However, the 
use of the method of undetermined coefficients in such t ^ses 
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(4) 


involves questions of convergence which never arise when f(x) has 
only a finite number of independent derivatives 

There is one important exception to the procedure we have 
just been outlining, which we must now investigate Suppose, for 
example, that we wish to find a particular integral for the equation 

y" + 4y' -1- 3?/ = 

Proceeding in the way we have just described, we would start 
with 

Y = Ae-^^ 

getting — V 2 Ae-^^ + 

0 I 5e-^^ (») 

This is obviously an impossibility, and it is important that we be 
able to recognize and handle such cases The source of the diffi¬ 
culty IS easily identified. For the characteristic equation of Kq (3) 

IS 


-|- 4m -1-3 = 0 

and, since its roots are rrii - — 3, m 2 = —1, the complementary 
function of Kq (3) is 


y = Cl. -h C 2 e ^ 


Thus, the term on the right-hand side of (3) is proportional to a 
term m the complementary function; that is, it is a solution of 
the related homogeneous equation and, hence, can yield only 0 
when it IS substituted into the left member 

One way in which we might attempt to avoid this difficulty 
would be to find a particular integral of the equation 

y" -f 4y' -h 3y = 

with k 7 ^ —S, and then take the limit of this solution as /c —> — 3. 
Thus, substituting as usual, we have 


k^Ae^^ -h 4kAe’‘^ -h 3^4 


whence, 


A = 


_5 

k^ 4 4^4 '3 


and 


Y = 


5c'' 


-h 4fc 4 3 


Unfortunately, the limit of this as A; —> —3 is infinite, and so we 
must look further However, since is a solution of the 

related homogeneous equation for all values of B, it follows, 
taking B = — 5/(A:* 4 4A: 4 3), that 

_ — 

~ ¥~+ 4fc + 3 


18 a particular solution of the homogeneous equation and, hence, 
that 

^ ~ V' - jfes + 4k Ts 
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IS another particular integral of the nonhomogeneous equation 
(4). Now as —> —3 [and Eq (4) approaches the given equation 
(3)], this function becomes an indeterminate of the form 0/0 
Evaluating it by L'Kospital's rule, we find that the limit is 

5xe“** 

and by direct substitution it is easily verified that this is actually 
a solution of Eq (3). 

It IS not necessary to go through this limiting process in 
particular cases where/(x) is proportional to a term already in the 
complementary function, for we have the following extension of 
Rule 1 

rule 2 If any term m the exprewssion Y normally used to find a particular 
integral of the nonhomogeneous equation ay" -b by' + cy — f(x) 
duplicates a term in the complementary funi^tion, then before it 
is substituted into the equation, Y must be multiplied by the 
lowest positive integral power of x which will eliminate all such 
duplications. 

The results of our discussion are summarized iii Table 2.2. 

toble 2 2 


DifferentKw equation ay" + by' -|- cy = fix) or (a/)® -b bD -b c)y “ fix) 


fix)* 

Necessary choice for particular integral Y t 

1 or 

A 

2 aX" 

(n a positive integer) 

Aqx'^ 4- 4 4 An-iX 4 An 

3 ac" 

(r either real or complex) 

dc’’* 

4 or cos kxX 

A cos kx B Bin kx 

6 a sin kx 

6 cos kx 

-4 4 .ix 4 cos kx 

4 iBox'' 4 4 Bn-ix 4 Bn)e’^* sin kx 

7 sin kx 


* When/(j) consists of a sum of several terms, the appropriate choice for Y 
IB the sum of the Y expreBsions corresponding to these terms individually 
t Whenever a term m any of the K’s listed in this column duplicates a term 
already m the complementary function, all terms m that Y must be multi¬ 
plied by the lowest positive integral power of x sufficient to eliminate the 
dimlication 

X l^e hyperbolic functions cosh kx and smh kx can be handled either by 
expressing them m terms of exponentials or by using formulas entirely 
analogous to those in Imes 4, 5, 6, and 7 
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EXAMPLE 1 

Find a complete solution of the equation y" -f- \}y == 2^* + 4j -f 7 
The cliaracteristic equation in this cajse is 

-H 9 = 0 

Since its roots are m = ± 3i =» 0 ± 3i, the complementary function is 
A cos B sin 3 j- 

According to Table 2 2, the necessary trial solutions corresponding to the respective terms 
in the right member of the differential equation are 

Aox^ -j- All A 2 anx 4- ai ao 

However, the last two are clearly contained in the first, and no extra geneialify i« achieved by 
includmg them Hence, we assume simply 

K “ A oJ* -4 AiJ- -j- ylj 

Sulistituting this into the differential equation gives 

'2An 4 9(4 ox’ 4 4- 40 = 2x^ 4 4x 4 7 

j (|uating (oedicientb of x, and the constant term x“, we obtain the three equations 
94 0 = 2 1)4, * 4 240 4 94^ « 7 

Hence, 4o = 4, = H A 2 » 

and HO a complete solution is 

18x*4 36x 4 59 

1 / »= 4 cos 3x -t- B sm 3x 4 - —- 

81 

EXAMPLE 2 

Find a con plete solution of the ecpiation y" 4 4y' 4 1)V = 3c" 

In this cawe the characteristic equation is 

4 4w 4' fi = 9 

and its characteristic roots are tn 1 , 7/12 =-24? Henct, the complcrnentary function is 
cos X 4 sm x) 

I'or the trial solution 1 normally corresjionding to the firm ^c'we have 1" = ('V"*’’ More¬ 
over, although each term of the complementary function contains c'as a factor, r"*' does 
not itself occur as a term m the complementary function, thereforr', it is unneiessary and m fact 
iiKorrect to modify F by multiplying it by any powi^r of x Hence, wo substitute Y = t into 
the given equation, getting 

4 CV- 2 X _ 4 = 3c or tV-*' = 3c-*^ 

Thus, r *= , 3 ^ the particular integral is }' = 3 c"*', and a romjilete solution is 
y anr f>-*'(4 ( 08 X 4 H Sill X) 4 3c 

EXAMPLE 3 

find a complete solution of the equation y" 4 5v' 4 by ™ 3c''*' 4 c*' 

The roots of the characteristic equation 

W 2 * 4 5m 4 6 ™ 0 

are nil ■= — 2 , m 2 = — 3 Hence, the complementary function is 

cic"*' 4 cjc"*' 
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For the tnal solution }'i corresponding to the term we would normally use Ae~'^ 

However, is already a part of tlie complementary function, and thus, following the sccoik] 
footnote to Table 2 2, we must multiply this by x before including it in Jb For the term 
the normal choice for a trial solution, namely, y j ** is satisfactory as it stands, since r’' 

18 not contained m the complementary function Hence, we assume 

)' - }\ + y, - Aie-*' + Be*' 

Substituting this into the differential equation, we have 

(4Axc-»* - 4Ae-*‘ -b 9Be*') + 5(-2Axt>-*' -b + 3Be*') 

-b A Be*') Se-*' 

or Ae~** 4 30Be*' *= 3e~** -b c*' 

B]quating coefficients of like terms, we find A “ 3 and B *= Ho Hence 



EXAMPLE 4 

Find a complete solution of the equation v" - 2y' + j/ “ xc* — c* 

The charectenatic equation here is 

m* — 2m -b 1 — 0 

and its roots are mi »= m? « 1 Hence, the complementary function is 

Cic' -1 are* 

According to line 6 of Table 2 2 (with n =>r-=l,A «=0)we would normally try 
y “ (Aoa: + Ai)f* 

as a particular integral (Note that the trial solution ordinarily required for — c*, namely, AiC', 
18 automatically included in this choice ) However, these terms are already contained in the 
complementary function, hence, following the second footnote in the table, we must multiply V 
by the lowest jiositivc integral power of x which will eliminate all duplication between T and 
the complementary function This means that 1 must be multiplied by x®, since multiplying it 
by X would still leave the term xe’ common to V and the complementary function Thus we 
continue with the modified choice 

Y - (AoT* + Aix*)c* 

Substituting this into the differential equation, we obtain 

(Aoi* -b (6Ao -b A,)x> -b (6Ao + 4A,)i -b 2A,]e' 

- 2[Aox» 4 (3Ao 4- A,)x’ -f 2A,xle- -b (Aox* + A.x»)c' = xc' - e* 

or 6Aoxc' + 2Aic' — xe* — c' 

This will be identically true if and only if Ao =* and Ai " Hence, 



0*1 c 90 a complete solution is 

, x*e‘ 

V “ cic" 4 r,Te*-— -I- 

2 6 
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EXERCISES 


Find a complete solution of each of the following equations’ 


1 v" + 4y' 3y ^ X - I 
3 )/" + y' “ :r d- 2 

6 y" + 2y' + lOy = 3a:* 

7 I/" - j/ =*= c* H- 2e*' 

9 (/J® d- 1 )|/ =“ c' Bin T 


2 y" -f- 3y' =■ sin r -j- 2 cos x 
4 I/" “h V “ I H- 3 sm 2i 
8 y" -f 4y' -h 13y = cos 3x — sin 3 t 
8 y" -F 4v' =■ X Hin x 
10 (Z)* -f 47Z -h 4)7/ - xe-* 


11 y" -t 2y' 4- y “ cor* x [Hint cos* x = (1 4- cos 2x)/2 ] 

19 \0y" - Gy' 4- y ” 4 am j coa x 

13 a Show that Y = - cosh x la a particular integral of the equation y" 4 y' - 2y ™ 

b Determine .1 such that Y =« 4 sinh x will be a particular integral of thiM equation 


Find that Mohition of each of the following equations -which satisfies the given conditione 


14 

16 

16 

17 


(/" 4 4y' -F 5y =" 2()c* 

7y" d- 4y' F 3y = 4c"' 
y" 4- 4?/' -t 4i/ = 2x + sin x 


y “ y' “ b when X ™ 0 
7/ = 0, y' = 2 when x •= 0 
7 / = 1, 7/' “ — 1 when X “ 0 


Show that y =• fsm - sin kt)/(k^ — X*) is a particular integral of the equation 


y^' 4 - fc*y = sin \l 

and Uivestigatc the hunting cose when \ —^k 
18 If 7 /, and yi are two solutions of the nonhomogeneoua equation 


y" -F P{T)y' + Q{x)y = R(x) 

show' that y = j/i -f- i/j is rn t a solution of this equation On the other hand, if i/i and yi 
aic, respect ivelv, solutions of the equations 

7/" F P(x)y' + Q(x)y = RAx) and y" + P{x)y' 4- Q(x)y - 70(i) 


show that V = ?/] 4 - yj la always a solution of the equation 
//" -F7’(x)y' F Q(x)y = /D(x) -F R 2 {x) 

19 If 7 /, IS a Holution of the homogeneous equation y" + P{x)y' 4* Q{x)y 0 , show^ that the 
Huhstitution of y = 0 yi will reduce the problem of finding a particular integral of the non- 
liomogencouN equation y" 4 - P{x)y' -h Q{x)y = R{x) to the solution of a linear equation 
of the first order 

20 (Tfling the nietliod of undetermined coefhcients, find a particular mtegral of the equation 
V" — y = 1 /x 


2.4 

Particular integrals by the method of variation 
of parameters 


For certain theoretical purposes and occasionally in apjilicatioiis, 
it IS desirable to be able to find a particular integral of the 
equation 

ay" 4- by' + cy = f(x) 

in cases where the method of undetermined coefhcients will not 
work, 1 e , when f(x) is not one of the simple functions possessing 
only a finite number of independent derivatives. A procedure 
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known as variation of parameters will do this for all linear equa¬ 
tions, including the general equation with variable coefficients, 

(2) y" -h P(x)y' -f- Qix)y = R(x) 

regardless of the form of R(x)j provided that a complete solution 
of the corresponding homogeneous equation is known This 
method differs from the method of undetermined coefficients m 
that integration rather than differentiation is involved,* which 
means that the price we pay for greater generality is usually the 
inconvenience of integrals which cannot be evaluated in terms of 
familiar functions 

The fundamental idea behind the process is this Instead of 
using two arbitrary constants Ci and C 2 to combine two independ¬ 
ent solutions of the homogeneous equation 

(3) y" -f P{x)y' -b Q{x)y = 0 

as we do in constructing the complementary function, we attempt 
to find two functions of x, say ui and U 2 , such that 

y = uiyi -b U 2 I /2 

will be a solution of the nonhomogeneoiis equation (2) Having 
two unknown functions ui and we require two equations for 
their determination One of these will be obtained by substituting 
Y into the given differential equation (2), the other remains at 
our disposal As the analysis proceeds it will become clear what 
this second condition should be 

From Y = uiyi -b W 22/2 we have, by differentiation, 

Y' = (wji/i -b u[yi) + (W 22/2 + ^ 21 / 2 ) 

Another differentiation will clearly introduce second derivatives 
of the unknown functions Ui and 1 / 2 , with attendant complica¬ 
tions, unless we arrange to eliminate the first derivative terms 
u[ and U 2 from F'. This can be done if we make 

(4) u[yi + 1 / 22/2 = 0 

which thus becomes the necessary second condition on u\ and 1/2 
Proceeding now with the simplified exprevssion 

F t f \ f 

= uiVi + UiVi 

we find Y" = (M,y'' + u[y[) + {uiy'^ + u'^y[) 

Substituting Y, Y', and Y” into Eq (2), we obtain 

(wij/i' + u[y{ + u,y',' + Uty't) + P(x){uiy[ + uty't) 

+ Q(x)(u,yi + Mji/s) = R(x) 
or 

Wily” + Pir)y'i + Q(x)yi] + u,[yt + P{x)y\ + Q(x)j/i] 

+ wjj/l + = R{x) 


This IB the origin of the name -parixcular integral. 
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The expressions in brackets vanish because, by hypothesis, both 
yi and 7/2 are solutions of the homogeneous equation (3) Hence, 
we find for the other condition on u\ and 

WiVi' + 

Solving Eqs (4) and (5) for u', and t/j, we obtain 


«; =- —7 R(x) 

yiVi - ym 


and 


U 2 = 


2/1 


2 / 12/2 - 2 / 22/1 


7 Rix) 


The functions yi, y 2 , y[y y't, and Rix) are all known Hence, Ui and 
U 2 can be found by a single integration. With Ui and U 2 known, the 
particular integral 


y = uiyi -h U2y2 
IS completely determined 

We should notice, of course, that, if yiy'^ — 2 / 22/1 = 0, the 
solution ioru[ and cannot be earned out However, yiy'^ — 1 / 22/1 
IS precisely the Wronskian of the two solutions 1/1 and 1 / 2 , and, if 
these are independent, as we suppose them to be, then their 
Wronskian cannot vanish. 


EXAMPLE 1 

Find a complete solution of the equation H- v “ sec x 

By inspection, we see that th omplementary function in this case is 

A COR X + B sin X 

Hence, taking 1/1 “ cos x and yz — sin x, we have from F^q (6) 

sin X 

I x) — am x(— sin x) 


Therefore, 
and, thus. 
Finally, 


[ cos x(cos X 


sec , 


— tan X 


cofl X 


j sec X = 1 
W 2 = J dx 


coH x(cos x) — sin x(— sin x) 

--/ tan X dx = In |cos x| and 
Uiyi + 2 / 2^2 “ On |co8 x|) cos x -F x sin x 
A cos X B sin x -f (In jco.s x]) cos x -F x sin x 


EXERCISES 

Find a complete solution of each of the following equations 

^ y" + 4j/' -F 4j/ » e~**/x* 2 4ij" -F 1 / =» (x* ~ l)/(x y/x) 

3 y" A 2y' y ^ In |x| 4 y" -F '^y' -F lOy = sec 3x 

3 Find a particular integral of the equation x^y" -F xy' — j/ — l/(x -F 1), given that - x 
and 7/2 = 1/x are two solutions of the related homogeneous equation 
0 Find a particular integral of the equation x'y” — xy' A- y — 1/x, given that j/i - x and 
" X In |xl are two solutions of the related homogeneous equation 

7 Find a particular integral of the equation x*y" — 2xy' -F 2^ “ x In [x], given that j/i — x 
and yz = i* are two solutions of the related homogeneous equation 

8 Using the method of variation of parameters, show that the expression 


1 [x 

y ^ A cos kx A- B sin kx A~ - am k{x — s)f{s) ds 


18 a complete solution of the equation y*' + k*y — /(x) 
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Find a complete solution of each of the following equations' 

9 y" + 2ay' + (o* - 6*)y - fix) 10 y" + 2ay' + (o« + b*)y = fix) 

11 v" H- 2ay' -f- a*y - fix) 

12 Using the method of variation of parameters, find a particular integral of the equation 
y" — y ^ \ fx How does this result compare with the result of Exercise 20, Sec 2 3? 


2.5 


Equations of higher order 

The theory of the linear differential equation of order highci 
than 2, 

(1) -f Px{x)y^--^^ -h -h l\-.^{x)y' -h I\{x)y = R{x) 

parallels the second-order case in all significant details In par¬ 
ticular, with the obvious changes required by the fact that 
n > 2, the three fundamental theorems of Sec 2 1 hold for linear 
equations of all orders For the especially important case of the 
homogeneous, linear, constant-coefficient equation of order higher 
than 2, 

(2) -f + • + dn^iy’ + a^y = 0 

the substitution y ~ e'"' leads, as before, to the characteristic 
equation 

(3) Oow" + -H + Qn-im 4- On = 0 

which can be obtained iii a speeific problem simply by replacing 
each derivative by the corresponding fiowcr of m The degree of 
tins algebiaic equation will be the same as the order of the differ¬ 
ential equation (2), hence, counting repeated roots the appro- 
pnate number of times, we hnd that tlie number of roots 
Wi, 77?2, will equal the order of the differential equation 
From the»^e roots, the solution of the homogeneous equation can 
be constructed by adding together the terms that were listed in 
Table 2 1, Sec 2 2, as corresponding to each of the various root 
types The only extension necessary is required when the charac¬ 
teristic equation (3) has loots of multiplicity greater than 2 Ij 
yi IS the solution normally corresponding to a root mi, and if this 
root occurs k (>2) times, then not only are yi and xiji solutions {as 


* Before Theorem 2, See 2 1, ran be extended to equations of higher order, 
it IS necessary that the Wronskian of more than two functions be defined 
The appropriate generalization is 



! 


yt 

Vn 


fVn) — 

y\ 

vi 

Vn 







which clearly reduces to the definition of Sec 2 1 if n = 2. 
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m the second-order case)^ but x^y\, . , x^~^yi are also solu¬ 

tions and must be included m the complementary function. 

For the non homogeneous, constaiit-coeffjeicnt e<iuation 

(4) -f + * -H «„-!?/' + OnlJ = R(X) 

it IS still true that the eoinjilctc solution is the sum of the eornplc- 
nientary funetion, obtained by solving the associated homogene¬ 
ous equation, and a particular mtegial In the iin})ortant case 
when RU) IS a function possessing only a finite number of 
independent derivativ^es the particulai integral can be found just 
as before by using the tentative choices for Y listed m Tnble 2 2, 
Sec 2 3 Variation of jiai a meters can be extended to those jirob- 
lems which the method of undetermined coefficients cannot 
liandle An example or t^v() will make these ideas clear 

EXAMPLE 1 

I'liul n coni plot p Holiitioii of the equation if' -f Ciit" -f \)i/ f 5v ^ 

Tlie cl'ararteristic equation in this case is 

ai’ 57)1^ f 9rn -h T) ->= 0 

Jh inspection* in ~ — I is seen to he n root Hence, cic"-' must be one term in the comple- 
iiicntni V function \\ hen tlie factor corresponding to this root la divided out of the characteristic 
cfjuiilion, tliere rernaina the quadratic equatifui 

m* -f 4n} 4-5=0 

lls loots urc T71 = —2 ± I, thuH, the complementary funciion must also contain 
c 2t(c 2 cos J -f- Cb Bin J-) 

'1 he entire ( omplementary function ir, tlierefore, 

Cif ^ -f- f cos j -t Cj am x) 

T‘<)r a particular intcpral ne try, as usual, }' == Substituting this into the differential 

» quation gi\ es 

(8Ac-') -t' 5(44f!*') + 9(2.4or 5li4c=** =- 3c*- 

1 e** 

Henci' d = r = 

17 17 

fix 

and, there fore, y = 4 cos x -p ci sin x) 4- " 

1 i 

EXAMPLE 2 

1‘ind a complete solution of the equation {IV -p 8/)* t UPy = — sin x 
3'hp characteristic equation here is 

nP 4- 8r7i* -P 16 = 0 or (w* -P 4)* - 0 

rile roots of this equation are m => ±2i, ±2t Henee, the complementarj function contains 
not only the terms 

cos 2r and sin 2x 

* In general, the most dillicult feature of the solution of a linear, constant- 
coefficient differential equation of order higher than 2 is the determination 
of the roots of the characteristic equation One useful procedure for doing 
this, Graeffe's root-iiquaring process, is discussed in the Appendix 
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but aleo these terms multiplied by x and is, therefore, 

Cl cos 2x -1“ ca Bin 2x -h ctx cos 2x -}- CtX sin 2x 

To find a particular integral we try Y — A cos x A- B sin x, which, on substitution into 
the differential equation, gives 

(A cos X B mr\ x) — A cos t — B am j) + 16(A cos i -1- B sin i) * — sin j- 
or 9A cos X -f- 9B sin X - — sin x 

This will be an identity if and only if ^ * Of and B = — Therefore, 


am j 



and the complete solution is 

sin X 

y c\ cos 2x -I- Ca sin 2x -f c*x cos 2x -1- c«x sin 2x — — 

EXAMPLE 3 

Find the solution of the equation {D^ -h 3/)* -|- 3Z>* + D)y » 2i + 8 for which y ~ y' y" 
y"' — 0 when x ■■ 0 

The characteristic equation in this case is 

m* + 3m‘ -h 3m> -h m = 0 or m(m -f 1)' = 0 

Its roots are m — O. —1, —1, —1, hence, the complemeniary function, taking due nccount of 
the triple root, is 

a + be~’ Y cxe~* + dxV* 

To find fl jiarticular integral we would ordinarily assume 
K - Ax + B 

However, one term in this expression (the constant B) duplicates a term already in the comple¬ 
mentary function (the constant a) Hence, we must multiply the original choice for }' by x 
before using it 

Substituting the modified expression => Ax* + Bx into the differential equation, we find 
0 A 3(0) + 3(2A) -I- (2Ax -i- B) - 2x -A 8 
or 2 Ax + (6A -f B) - 2 x -I- 8 

For this to be identically true requires that A — 1 and B — 2 Hence, K — x* -I- 2x, and the 
complete solution is 

(5) y — a 4* fee“* 4- cx€~* 4* dx*e“* A x® -|- 2x 

In order to impose the given initial conditions, it is necessary that we have expressions for 
y\ y", and y'" os well as for y Hence we differentiate, getting 

(fi) y' — —be'* -f- c(e~* — xe~*) -f d(2xe~* — -f- 2x 4- 2 

(7) y" » be~* 4- c( —2f~* 4* xe~*) A d{2€~* ~ ixe'* A x*c‘*) -H 2 

(8) y'" ■■ —be'* + c(3e"' — xe~*) -f d( —6c"* 4 6xc“* — x*f“*) 

f Since the differential equHtion eontaina only derivativea of e\en order, we could have 
foroBOen that 1' would contain only a sine term and that Y - H sm x would be a satisfactory 
initial "guess 
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Substituting the given conditions into Eqs (5), (6), (7), and (8), we 6nd 
0 - a -f 6 

0 - - 6 + c +2 

0 - 5 - '2c 2d -h 2 

0 « - 6 + 3r - 6d 

Solving these simultaneously for a, b, c, and d gives 


and, finally, 


a - -12 6 = 12 c - 10 d - 3 

V * -12 + 12e-* + lOzc-* -I- + 2t 


EXERCISES 

Find a complete solution of each of the following equations 

1 (D' dlP + 11Z> + 6)v = fij- - 7 2 (D* ~ my - c* 

y'" — 2y" - 3 1 /' + lOi/ »= 40 cos r 4 + lOy" + 9|/ — cos 2x 

iD* -f 8/)* - 9)y = j* + sin 2t 6 (Z)> -f D* + 3D - 5)y - e* 

D)y = 8 (D* - 64)V = 16 sin 2x 

Find that solution of each of the following equations which satisfies the given conditions 


3 
6 

7 (ir 


9 (D* -f- 2D* — D — 2)y = sin j ^ « y' = y" = 0 when x — 0 

10 (D* - 2D» -f 2/)» - 27; -J- l)v = c y - y' =* y" » y'" = 0 when j «« 0 

11 (7^* — 27;* -|- 7; — 2)y »= v- y « y' » y" = i when x =» 0 


12 For what values of X, if any, does the equation — \*y =»= 0 have a nontrivial solution 
satisfying the conditions y = y' = 0 when r = 0 and ?/" -> y'" = 0 when x * 1 ? (Hint 
The work is easier if a complete solution containing trigonometric and hyperbolic functions 
IS Used instead of one containing trigonometric and exponential functions ) 

13 Using the method of variation of parameters, obtain a formula for a particular integral 
of the equation 

(D* - 6D* -I- 11 D - 6)y - /(x) 

14 If three functions are linearly dependent, prove that their Wronskiari is identically zero 
IB Prove that the Wronskian of the functions c*"'', and f"** is different from zero if and 

only if TMi, 1712 , and mj are all different 


2.6 

Applications Linear difTerential equations with constant coefficients find their 
most important application in the study of electrical circuits and 
vibrating mechanical systems. So useful to engineers are the 
results of this analysis that we shall devote an entire chapter to 
its major features. However, there are also other applications of 
considerable interest, and, although we cannot discuss them at 
length, we shall conclude this chapter with a few typical examples 
One important field m which linear differential equations 
often arise is the study of the bending of beams. When a beam is 
bent it is obvious that the fibers near the concave surface of the 
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FIGURE 2.1 
A beam before 
and after 
bendjHK 



Neutral 

axis 


beam arc compressed whereas those near the convex surface are 
stretched Somewheie between these regions of compression and 
tension there must, from considoiations of continuity, be a sur¬ 
face of fibers which are neither compressed nor stretched This is 
known as the neutral surface of the beam, and the curve of any 
particular fiber in this surface is known as the elastic curve or 
deflection curve of the lieam The line in wdiich the neutral surface 
IS cut by any plane cross section of the beam is knoun as the 
neutral axis of that cross section (Kig. 2 1) 

The loads whicli cause a beam to bend may be of two sorts 
They may be* concentrated at one or more points along the beam, 
oi they may be continuously distributed with a density v){t) 
known as the load per unit length. In either case we have two 
important related quantities One is the shear V{x) at any point 
along the beam, wdiich is defined as the algebraic sum of all the 
transverse forces which act on the b(‘am on tlie })(^sitive side of the 
point 111 question (Fig 2 2). The other is the moment M (x), which 
IS defined as the total moment produced at a general point along 
the beam by all the forces^ transverse or not, which act on the 
beam on one side or the other of the point m (luestion We shall 
consider the load per unit length and tlie shear to be ])ositive if 
they act in the direction of the negative ^-axis The moment we 
shall take to be jiositive if it acts to bend the beam so that it is 
concave toward the positive 7 /-axis With the^e conventions of 
sign (which are not universally ado])ted) it is shown m the study 
of strength of matei*ials that the deflection of the beam y{x) 


FIGURE 2.2 

Plot (showing the 
conventions for 
the signs of the 
moment, shear, 
and load per unit 
length a 
general point 
of a beam 



A/(x)>0 
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satisfies the second-order differential equation 
(1) Ely" ^ M 

where K is the modulus of elasticity of the material of the beam, 
and I, whi(‘h may be a function of r, is the moment of inertia of 
the CToss-section area of the beam about the neutral axis If the 
beam bears only transverse loads, it can be shown further that 
we have the two additional relations 
^ diEly'J ^ 

‘ (Lc ^ dx 

dH1 dV dHEh/') 

In most elementary a|)plications the moment M is an explicit 
function of r, hence, Eq (1) can be solvi'd and the deflection y{x) 
determined simply by performing two integrations However, in 
problmns m whidi the load has a component m the direction of 
the length of the beam, M depends on ?y, and Eq (1) can be 
solved only through the use of techniques from the field of differ¬ 
ential equations An interesting example of this sort is provided 
by the classic problem of the buckling of a slender column 

EXAMPLE 1 

\ loll*;, Hlcndor folumn of length 1, and uniform cross sertion whoae ends are constrained to 
rermiiri in the same vertical line l)ut are otherwise free (i e , are able to turn) is compressed by a 
load F 1 )etermine the possible deflection curves of the column and the loads required to produce 
'^ ach one 

Let I oordiriates he chosen as shown in Fig 2 3 Then, dearly, the moment arm of the load F 
nhout a g(‘iicral point P on the deflection curve of the bt^am is 7 /, hence, Eq (1) liecornes 
(4) Ely'' = ~Fy 

die minus sign indicating that, when y is positive (as shown), the moment is negative, since it 
lias jiroduced a deflection curve which is convex toward the positive 

By hypothesis, the column is of uniform cross section, hence, the moment of inertia / is a 
coiistant Therefore, (4) is a constant-coefficient difTerenlial equation and can be solved by the 


figure 2 3 
A slender column 
hiickhng under 
n vertical load 
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methods of Sec. 2 2 Accordingly, we set up the characteristic equation 


Elm^ -|- F 


and solve it, getting 


* VF;’ 


Hence, a complete solution of (4) is 


^ — A cos 


a: -I- B sin > 


To determine the constants A and B, we have the information that y = 0 when j — 0 and 
also when a: — L Substituting the first of these into Eq (5), we see at once that A = 0 Sub¬ 
stituting the second, we obtain the equation 


Since Bin \/ F/EI L is in general not equal to zero, it follows that B = 0, which, since we have 
already found A — 0, means that y 0 However, if the load F has just the right value to make 
y/FjEl L “ nir, then the last equation will be satisfied without B being 0, and equilibrium is 
then possible in a deflected position defined by 


V - B sin 


Since n can take on any of the values 1, 2, 3, , there are thus infinitely many different 

critical loads 



each with its own particular deflection curve For values of F below the lowest critical load, the 
column will remain in its undeflected vertical position or, if displaced slightly from it, will return 
to it 08 an equilibrium configuration For values of F above the lowest critical load and different 
from the higher critical loads, the column can theoretically remain in a vertical position, but 
the equilibrium is unstable, and, if the column is deflected slightly, it will not return to a vertical 
position but will continue to deflect until it collapses Thus only the lowest critical load is of 
much practical significance 


In many physical systems vibratory motion is possible but 
undesirable In such cases it is important to know the frequency 
at which vibration could take place in order that periodic external 
influences that might be m resonance with the natural frequency 
of the system can be avoided For simple linear systems in which 
(as is usually the case) friction is neglected, the imderlying differ¬ 
ential equation is eventually reducible to the form 

y'' -h oiV = 0 

Since the complete solution of this equation is 
y A cos (at B sin (at 
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and since both cos and sin a?/ represent periodic, behavior of 
frequency 

Lo rad/unit time or ^ cycles/urnt time 

it IS clear that the frequency can be read just as well from the 
difTerential equation itself as from any of its solutions, general or 
particular. The important part of such a frequency calculation, 
then, IS the formulation of the differential equation and not its 
solution 


EXAMPLE 2 

A W'l ifl suHponded from a pulley of weight H' i, as shown in Fifi; 2 4 Constraints, which 

need not ho apocihod, provent any swinging of the systt-in and permit it to moeo only in the 
vertical dirt otion Tf a spring of modulus /c, that is, a H[)ring requiring A units of foroo to stretch 
it one unit of length, is inserted in the otherwise incxtcnsihle pahle which auppoits the pulley, 
find the freijueney with which the system will vibrate in the vertical direction if it is displaced 
slightly from its eiiuilihriuin position Friction between the cable and the pulley pri'ventfa nny 
di|)page, but all otlier frictional effects are to be neglected 

As poordmate to describe the system we choose the vertical displacement ?/ of the center 
of the pjlley, the downward direction being taken as positive Now whim the center of the 
pulley moves a distance V; the length of the spring must cliange by 2// Moreovei, as this happens, 
I lie pulley must rotate tlirough an angle 


ff =» 


V 

R 


and 


de 1 dy 
Vlt * R lit 


It will be convenient to foimulate the difTerential equation governing this problem through 
Iho use of the so-ealled energy method From the fundamental law of the ronsi'rvation of energy, 
It follows that V no fnerqy is Inst through friction or other irreversible changes, then in a mechanical 
sgstem the sum of the instantaneous potential and kinetic energifs rniisl remain constant In the 
present problem the potential energy consists of two parts (tt) the potential energy of the 
weights TFj and Wj due to their position in the gravitational field and (h) th-- potential energy 
stored in the strelehod spring Taking the equilibrium position of the system as the reference 
level for potential energy, we have for (a) 

(fi) (PE)„ = - (IF, + \\\)y 

the minus sign indicating that a positive y corresponds to a lowering of the weights and, hence, 
a decrease in the potential energy The potential energy stored in the spring is simply the amount 
i>f work required to stretch the vSpnng from its equilibrium elongation, say 6, to its instantaneous 


figure 2 4 

An unusual spring- 
‘^uapended weight 
U) equilibrium and 
after a vertical 
displacement 
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elongation 3 + 2j/ Since the force m the spring at any time is 

F — elongation X force per unit elongation — sk 
we have for the potential energy of tyiie h 

ri-\-2y i« + 2w 

(7) (PE)6 - / F da j ka ds ^ k — \ »- 2ky^ + 2k6y 

Ja\ J6 2 1^ 


The kinetic energy likewise consists of two parts (a) the energy of translation of the 
weights Wi and W^, namely, 


(8) 


(KE)„ - ] (v)n 

^ (7 


(9) 


(KE)^ 


2 \Ji) ~ 4(7 


ivy 


and (o) the energy of rotation of the pulley, namely, 

The conservation of energy now requires that 

Kinetic energy -1- potential energy = constant 
or, substituting from Eqs (6), (7), (8), and (9), 

W W w 

— (v)’ + -- 4 -- (v)' + (2A-!/’ + 2kiy) - (W, + W,)y ~ C 

Diffirt'cntiating this with respect to time, we have 


W, W, + IPj 

— ?/!/ +- yV + + 2/r52/ - (W^ W2)y - 0 

g 

or, dividing out y (which surely cannot be identically zero when the system is in motion) and 
collecting terms, 

3H’, + 2Wr 

- ^^ky ^ + W,) - 2^3 - 0 

2 (/ 

the terms on the right equaling zero since the elongation 3 of the spring in its equilibrium 
position IS 

, TTi + W, 

2k 


The differential equation describing the vertical movement of the system is, therefore, 


From this, os we 
system, namely, 


^ STT, + 2 W,^ " 

pointed out above, we can immediately read the natural frequency of the 


1 / 8fcg 

^ \.Wr+21Fi 


cycles/unit time 


In general, difTerential equations with variable coefficients 
are very difficult to solve and rarely can be solved in terms of 
elementary functions However, there is one important linear 
differential equation with variable coefficients which can always 
be reduced by a suitable substitution to a linear equation with 


t In problems in dynamics, first and second derivatives wUh respect to time 
are often indicated by placing one and two dots, respectively, over the 
variable in question 
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constant coefficients and hence solved without difficulty This is 
the so-called equation of Euler* 

(10) -f -f -j- a^-ixy' -f o„y ^ 0 

ir which the coefficient of each derivative is proportional to the 
corresponding fiower of the independent variable If we change 
the independent variable from j to by means of the substitution 

X ~ oi z = In j- 

Eq (10) becomes an equation in y and z with constant coefficients 
which can then be solved by the methods of Sec 2 5 Finally, 
replacing z by In r m the solution of the transformed iquation we 
obtain the solution of the original differential equation 


EXAMPLE 3 

1‘jnrl ;i coiiiplct*' sulution f)f llir clifTorrntial oquatH)n 


' — H 4j-2—- - .Sj 
dx^ dx^ dx 


lindrr tlw' transfornnition j- = 

dy di/ dz 1 dij 
dx dz dj T dz 


- 15// =» 0 
In X w(' havr 


d^y 

- 1 


J dy 

1 d'^y dz 

J- 7h‘ iis ^ 

1 dy 1 d*y 


r/x“ 

dx ’ 

b ''V 

X* dz 

x’* dz x^ dz’^ 


fTy 

d 

b'f- 

dy f/^A 



dh/ 

d7' 

d r 


dz dz"^) 

J 

,h <!:■) X-- ( 

dz- 


dy\ 

dz*) 


dz 


2 (h 
X* dz 


I) d^y 1 d*y 

X® dz"^ X* f/^* 


Substif nt inp thpsf into tlic fjiven clifTorontial oquation, \\v hnvt* 


.J ' _ ,'1‘! + l-Al + 4 .^ ' ( - ^ - rJ' - -r.v = .. 

j X* y dz dz^ dz*J L\ ^ ^ / 

or, Him jil/f-y ]ng and rollt-rtinK icrnia, 

d*n d*v ^dy 

— H-— 7— — 15// = 0 

dz' dz^ dz 

'rh(‘ charaoioristic c’qnation of thr last equation is 

m* f 771^ — 7m — 15 = (m — 3)(rn^ -|- 47/1 + 5) = 0 
from Its roots, n/, = 11, mj =■ — 2 4 Wj = —2 — 7, ol>tam t lio corni/leto solution 
7 / = rie*' -b cos c -f rs sin z) 

finalh, rcqilaciriR z by In x, we have 

y = rir®'" ^ -f r *[r. cos (In x) -|- cj sin (In x)] 


= fix^ 4- [Ci (()s (In x) -j- ti sill (In x)] 


* Also calletl Cauchy's equation, after the Frericn inathcinatiemn Augustin 
Louis Cauchy (1789 1857). 
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EXERCISES 

Find a complete solution of each of the following equations 

1 x^y"' + 2x*y” — tj/' -f y - 0 2 I'y'" — -f 7xy' — 8j/ “ 0 

8 2®* ^ 5x ^ + j/ - 3i + 2 
ax* ax 

4 Since e* is always positive, does the use of the substitution x “ e' mean that an Euler equa¬ 
tion can be solved only for positive values of x? How can a solution be obtained which will 
be valid for negative values of x? 

6 If X — e' and if - ^ D, establish the operational equivalences 



- r>(D - l)(D - 2 ) 

ax* 


Explain liow these formulas can be used to shorten the work of solving an Euler equation 
6 a Show that the substitution Ax + /f =* or 2 = In (Ax -f li), will reduce th(‘ equation 


d^u dn 

a(/lx + H)^ — -f b{Ax B) — + y 
r/x^ dx 


0 


to a linear ecpmtion with constant coefficients Do you think that, for n > 2, the equation 


aii(Aj 'f B)’' — ^ -b ai(Ax 4 B)’' * ^ B 4 an-i(Ax + B) y 4 flnV = b 

c/x” dx""‘ di 

can be solved in a ainiilar fashion? 
b Find a complete solution of the eapiation 


, d^V 

(j - 2)2 — 

dx* 


4 2{x - 2) 


dy 

dx 


67 / 


7 A circular rylinder of radius r and height li, made of material weighing w l))/in floats in 
water in such a way that its axis is always vertical Neglecting all forc(‘s I'xcept gravity and 
the buoyant force of tlio water, as given by the principle of Archimedes, determine the 
period with w hu'h the cvlinder wull vilirate 111 the vertical direction if it is depressed slightly 
from its equilitirium position and released 

8 A cylinder weighing fiO lb floats in water with its axis vertical When depressed slightly 
and released, it vibrates with period 2 sec Neglecting all frictional effects, find the diameter 
of the cylinder 

9 A straight hollow^ tube rotates about its mid-point with constant angular velocity w, the 
rotation taking place m a horizontal plane A pellet of mass m slides without friction in the 
interior of the tube Find the equation of the radial motion of the pellet until it emerges 
from the tube, asaunimg that it starts from rest at a radial distance a from the mid-pomt 
of the tutie 

10 A straight holJow' tube rotates about its rnid-point with constant angular velocity u, the 
rotation taking place in a vertical plane Show' that if the initial conditions are projierly 
chosen, a pellet sliding without friction in the tube will never be ejected but w-ill execute 
simple harmonic motion wuthin the tube 
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11 Neglecting the effect of its own weight, show that the deflection of a uniform cantilever 
beam at the point j ^ Xa due to a unit load at the point j: = zj is equal to the deflection 
at X — Xi due to a unit load at x — xo 

12 A uniform cantilever beam of length L is subjected to an oblique tensile force F at the free 
end Find the tip deflection as a function of the angle 6 between the direction of the force 
and the initial direction of the beam 

13 A long, slender column of uniform cross section is built in rigidly at its base Its upper end, 
which 18 free to move out of line, bears a vertical load F Determine the possible deflection 
curves and the load required to produce each one 

14 A uniform shaft of length L rotates about its axis with constant angular velocity a> The 
ends of the shaft are held m bearings which are free to swing out of line, as shown in Fig 12 5, 


FIGURE 2 5 




if the shaft deflects from its neutral poHitu»n Show that there are infinitely many critical 
speeds at which the shaft can rotate in a deflected position, and fand these speeds and the 
naaofiated deflection curves [flmt During rotation, centrifugal force applies a load per 
unit h'ligth given by 


u}(x) 


pA 

- y 

p 


NS here A is the crops-section area of the shaft and p is the density of the material of the 
hliaft Sul)stilute this into Ecj hi), solve the resulting differential equation, and then impose 
the eonditions that at x = 0 and at x = /> the deflection of the shaft and the moment are 

Z(TO ] 

16 Wor,< Exercise 14 if the hearings are hxed in position and cannot swing out of line 

16 A cantilevtT beam has the shape of a solid of revolution whose radius vanes as \/x, where x 
IS the distance from the free end of the beam A teii.sile foree F is a[)plied at the free end of 
the beam at an angle of 45" with the initial direction of the l)eam Find the deflection curve* 
of the beam 

17 A weight W hangs by an mextensible cord from the* cirr uinference of a pulley of radius R 
and moment of inertia / The pullc^y is pieventi'd from rotating freely by a -Si)r]ng of modu¬ 
lus k, attached as shown in Fig 2 Considering only dis|)Jacenienta so small that the 
departure of the spring from the horizontal can be neglected, and neglecting all friction, 
determine the natural frequency of the oacillations that occur when the* system is slightly 
disturbed (Hint Use the energy method to obtain the differential equation of the system ) 


figure 2 6 


p 



W 
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16 Under the assumption of very small motions and neglecting friction, determine the natural 
frequency of the system shown in Fig 2 7 if the bar is of uniform cross section, absolutely 



19 Under the assumption of very small motions and neglecting friction, determine the natural 
frequency of the system shown in Fig 2 8 if the har is of uniform cross section, absolutely 
rigid, and of weight le 



20 A perfectlv flexible cable of length 2Jj, v\eighing xv lb/ft, hangs over a frietionless peg of 
negligible (liaiiutcr At t = Othe » able is ndeased from rest m a position in which the jiortion 
hanging on one side is n ft longer than that on the othei Find the equfitif>n of motion of 
th(‘ cal 1(‘ as it sb]'' ovit the peg 

21 A pel fectly flexibh^ cable of length L and weighing ?/> Ib/ft lies in a straight line on a fnction- 
lesH table top. a ft ot the able hanging over the edge At i = 0 the cable is released and 
liegins to slide off the edge of the table Assuming that the height of the table is greater 
than L, determine tJie motion of the cable until it leaves the table top 

22 A perfectb flexible cable of length L, weighing to Ib/ft, hangs over a pulley as shown in 
Fig 2 {) The radius of the pulley is U, and its moment of inertia is 7 Fneliori betwi'en the 


FIGURE 2 9 


cable and the pulley prevents any relative slipping, although the pulley is free to turn 
without appreciable friction At f = 0 the cable is released from rest in a position m which 
th** portion hanging on one side is a ft longer than that hanging on the other Determine 
th»i,piotlon of the eable until the short end first makes contact with the pulley 
23 Negh'cting friction and ossuiniiag angular displacements ^ so small that 0 is a satisfactory 
approximation to sm 8 and 0^/2 is a satisfactory approximation to 1 — cos 0, find the 
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natural frequency of the Myatem shown in Fig 2 10, if the bar is of uniform cross section, 
abf 50 lut(‘ly rigid, and of weight w 



24 Neglecting fru tion and a.^Mitning angular displacements 0 se small that fi is a satisfactory 
apliroMination to sin and is a satisfactory approvimation to 1 - cos find tlie 

natuuil frecpiency of the system shown in Fig 2 11, if the bar is of uniforin cross section, 



absolutely ngid, and of vvmgbt //’ In what significant resped does this system ditb'r from 
that discussed in Exercise 2d? 

2B a Two disks each of moment of inertia / aie connected by an elastic shaft of modulus k, 
tliat IS, a shaft which requires A units of torejur to twust one end through an angle of one 
radian nith lespect to the other end The sy^stern is mounted m a fnetionlesa bearing, as 
show n m Fig 2 12 Neglecting the moment of inertia of the shaft, find tlie natural frequency 


figure 2 12 


/ 


k 

I 




! 


1 


with which the disks will oscillate if they are twisted through equal but opposite angles 
and then released 

b What IS the natural frequency of the system if the moments of inertia of the disks are 
respectively 1 1 and / 2 ? (Hint Not only does the total energy of the system remain con¬ 
stant, but so does the total angular momentum ) 



CHAPTER THREE 


Simultaneous 
Linear Differential 
Equations 


3.T 


Introduction In many piohlems m applied mathematics there are not one but 
several dependent variables, each a function of a single independ¬ 
ent variable, usually time The formulation of such a problem in 
mathematical terms frequently leads to a system of simultaneous 
linear differential equations, as many equations as there arc 
dependent variables 

There are various methods of solving such systems In one, 
which bears a strong resemblance to the solution of systems of 
simultaneous algebraic equations, the system is reduced by suc¬ 
cessive elimination of the unknowns until a single differential 
equation remains This is solved, and then, working backward, 
the solutions for the other variables are found, one by one, until 
the problem is completed A second method, which amounts to 
considering the system as a single matric differential equation, 
generalizes the ideas of complementary function and particulai 
integral and, through their use, obtains solutions foi all the 
variables at the same time Finally, the use of the Laplace trans¬ 
formation provides a straightforward ofieratioiial procedure for 
solving systems of linear differential equations with constant 
coefficients, which is probably preferable in most ajiplK'ations to 
either of the other methods 

In this chapter we shall attempt through examples to present 
the first two methods, leaving the third to Chap 7, where we shall 
discuss the Laplace transformation and its applications in detail 
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3.2 


The reduction of a system to a single equation 


( 1 ) 


CM 


< 4 ) 


Consider the following system of equations. 


If we subtract twice the second equation from the first, we obtain 
-9 j- + fll~ I3y = e-' - 2t 


If we subtract the second equation from 5 times the first, we 
obtain 


d( 


+ ] 4 2 - 2iy = 5f-' - I 


Finally, if we differentiate Kq (1) and add it to Eq (2), all 
occurrences of j will be eliminated and we shall have an equation 
in y alone 


_L 

di^ dJ 


- 4c-‘ - t - 2 


It. is now a sini])le matter to solve tins equation by the methods of 
Chap 2, and we find without difficulty 

y = cic‘ -h -f 


Vaiious jiossibilitic'^ are available foi finding x Hy far the 
sim})lest IS t.o use Im} (1), whu h giv(*s x direi'tly in terms of y and 
its derivative Tims, 


■' - 5 (a ■ + ■' “ '") 


= J[( 


ric‘ 


, c^€' 


2r2e-2' -h ^ f 2c'' 


) 






CiC^ -f C2C + 


2 + 1- 2 '-') + »- 


t 


-h :ic 


Eciuations (2) and (4) constitute a complete solution of the 
original system 

In general, tlie steps m the reduction of a system of eciuations 
to a single equation are not so obvious as they were in the example 
we have just worked For this reason it is freciuently convenient 
to rewrite the given equations m the D notation Then, if we 
regard the operational coefficients of the variables as ordinary 
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( 5 ) 


algebraic coefficients, the method of elimination will usually be 
apparent Still more systematically, determinants can be used to 
obtain the single equation satisfied by any one of the unknowns, 
very much as in the case of linear algebraic equations 

Suppose, for definiteness, that we have the second-ordn 
system 

(aiiD‘* “h huD + C\i)jr -|- -h h\ 2 D -j- C\2)y = ^i(f) 

-h hiiD 4 - C2i):r -h (^22^^ + 622^ + ^22)?/ = 02(0 

or, more compactly, 

P ii(D)x + Pi2{D)y = 0 i(O 

p2l(P)-^ "h p2l{P)y = 02(0 

where the P’s denote the ])olynomial operators which act on .j 
and y. If these were, as indeed they a])pear to be, two algebrau' 
equations in x and y, we could eliminate y at once by subtiacting 
PuiP) times the seeond equation from p22{P) times the hrsl 
e([uation, getting 

\Pm(P)P 22 (D) - Px 2 {D)P,,{D)\i -- p22(/P0l(O - PniD)4>2{t) 

IMoieoN'cr, this procedme* is clearly valid e\'(m thongb the system 
consi'^ts of differential equations iatli(‘i than algebraic eijuations 
i'or "multiplying” the first equation by 

P2i(P) — CL22p^ -f" ~h C22 

IS simply a way of peiformmg m one step the ojieiations of adding 
^22 times the second derivative of the equation and 622 times the 
first derivative of the equation to C22 times the eipiation itself, and 
these steps are individually uell defined and (‘ompletely correct 
Similarly, "imiltqiiying” the second eipiation by 

P\ 2 {P) — ci\ 2 p^ "h bul) “h C12 

merely furnishes m one step the sum of ai2 times the second 
derivative of the equation, 612 times the first derivative of the 
equation, and C12 times the equation itself Finally, the subtrac¬ 
tion of the two equations ohtamerl by the "mult iplications” \^ e 
have just described eliminates y and each of its derivatives 
be cause these operations produce in each equation exactly the 
same combination of y and its various derivatives Similarly, of 
(‘ourse, I can he eliminated from the system by subtracting 1 \\{D) 
times the first equation from Pu{P) times the second, leaving a 
differential ecjuation from whi(;h y can be found at once 

The pieceding observations can easily be formulated in 
determinant notation In fact, the (operational) coefficient of x in 
Eq ( 5 ) IS simply' the determinant of the (operational) coefficients 
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of the unknowns in the original system, namely, 

PuiO) Pi2(D) 

P 2 i(D) P,,{D) 

Furthermore, the right-hand side of (o) can be identified as the 
expanded form of the determinant 

Ml) Pi2(D)\ 

Ml) I 

provided we keep m mind that the operators P\i(D) and P^i^P) 
must ofierate on and respeetively, and hence the 

diagonal products must be interpreted to mean 

Pll{P) 4 >\{j) P 12 (P)^ 2 U) 

and not <t>i{{)p22{P) and <t>2{0Pn{P) 

Thus, hkj (f)) can be written in the forn’ 

<Ai(0 Pi2( P) I 

Ml) c,,(/;)! 

which IS precisely what Cramer's lule (Theorem 7 , Sec 10 5 ) 
Avould yield if applied to the given system as though it wore 
])uiely algebraic In just the same way, the result of eliminating x 
fiom tin* or, nal system, namely, 

\Pn{D}P'n{n) - Pnif))P‘nU))]y = Pn{D)<t>,it) - P2i(/^)0i(/) 
can be written 

Pu{D) 4 >i{l) 

Pll{P) 02(0 

The use of Cramer’s rule to obtain the diffeiential ccpiations 
satisfied liy tlie individual dejieudent variables is in no way 
restricted to the (as(‘ of two e(piations in two unknowns J^]xactly 
tlie same jnoceduri^ can be ajiplied to systems of any number of 
(Mjualions, regaull(‘ss of tlie d(‘gi(*('s of the iiolynoniial operators 
which appeal as tin* (oeffn'Kiits of the unknowns Moreover, as 
hkjs (0) and ( 7 ) illustrate, the jiolynoniial operators ap[n\aring ni 
the left niembeis of the eipialions which result wdien the original 
system is “solved" for the various unknowns are identical Hence 
the cliaraclenstrc e((uations of these differential (‘(luations are 
identical, and, therefore, excejit for the presence of different 
arbitrary constants, the (omplementaiy functions m the solutions 
for the various unknowns are all the same The constants m these 
complementary functions are not all independent, however, and 
lelations will always exist among them serving to reduce their 
number to the figure required by the following theorem * 


( 7 ) 


P-n{D) P,,(D) 


I‘u(D) 

Pu(D) 


ru{i)) 

p 22 iP) 

r — 


* For ti proof of this result see, for instanre, L Ince, "Ordinary DifToren- 
tial I'^quatioiiH,'’ pp 144 150, Oovor Publications, Inc , New York, 1944. 
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THEOREM 1 

If the determinant of the operational coefficients of a system of n linear differ¬ 
ential equations with constant coefficients is not identically zero, then the number 
of arbitrary constants in any complete solution of the system is equal to the 
degree of the determinant of the operational coefficients, regarded as a poly¬ 
nomial in D. In particular cases in which the determinant of the operational 
coefficients is identically zero, the system may have no solution or it may have 
solutions containing any number of arbitrary constants 

The necessary relations between the constants appearing initially 
m the solutions for the unknowns can always be found by substi¬ 
tuting these solutions into all but one of the n equations m the 
original system (though not necessarily each set of n — 1 equa¬ 
tions) and then equating to zero the net coefficients of the terms 
that occur in each of these equations. 

EXAMPLE 1 

Find a complete solution of the system 

HD’ + \U) + 2)t -f (i>» + 2D -I- = P 

( 8 ) 

(2D» - D - 2)x H- (D^ -f /) + l)v = 8 
From the preceding discussion we know that the equation satished by j is 


30* 4- 30 4- 2 

O* -b 20 4 3 



O* 4- 20 4 3 

20* - 0-2 

O* -b Obi 

X ^ j 

8 

O* -r 7) + 1 


or, expanding the determinants and operating, as required, on the known functions and S,* 
(D^ + 3D» 4- 6D2 4 V2D 4 8 )j - 3c‘ - 24 

The roots of the characteristic equation of this differential equation are 1, —2, f 2i Hence 
the complementary function is 

-f ( 4' f 3 cos 2i 4- Ci Bin 21 

It 18 easy to see that 

A = - - 

10 

is a particular integral, and therefore 

e* 

(9) T — rif“‘ 4 -h cs eos 2t -4 sin 2t -|-— 3 


* In carrying out these expansions it must be borne in mind that the opera¬ 
tional elements in the determinant on the right operate on the algebraic 
elements c' and H, whereas the elenients in the determinant on the left all 
operate on x and not on each other This is the reason wdi> in expanding 
the determinant on the right we have reductions such as 

Z>®8 = 0 and 2D8 = 0 

whereas in expanding the deternunant on the left we have only formal 
multiplicatioTiB such as 

20*3 = 60* and 0*(-2) = -20* 
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Thp solution for y ran now be found by substituting the last expression into either of the 
original equations and solving the resulting differential equation for y However, it is usually a 
little easier to use Cramer’s rule again Doing this, wc find that y must satisfy the equation 


3Z)2 4 3/d 4 2 

IP 4 2D 4 3 


1 SIP 4 3D 4 2 

e‘ 

2rp - D - 2 

D“ 4 D 4 1 

y * 

1 2D2 - D - 2 

8 1 


or (D' + 3/)> + 6D2 + 12Z) + S)v - e' -f 10 

The solution of this presents no difficultv, and we find at once that 

r‘ 

, 10 ) 1 / “ ' + ^ 26 ”®' H- ki ros 2t -f ki sin 21 -}- + 2 

However, Eqs (0) and (10) do not yet ronstitute tlu* solution of the given system, siriee 
follKtivily they root,am eight arbitrary eonatantt., whereas, areording to Theorem 1, the eom- 
pleLe solution of (K) euri rontam only four constants To afeornplish tlie necessary reduction m 
the uumher of constants we must now^ substitute from (0) and (10) into either one oi the other 
i\ p into all but one) of the original equations, say the second 

[21)'^ — I) ~ 2^ f r 2 r'*' 1 ca cos 2( 4 r^ sm '2f -t — '4^ 

4- [IP + D 4 1) ^kif~- 4 k-€~^^ 4- k^ cos 2t 4 A-< sm 2t 4 f 2^ = S 

'ir, performing the indicated differentiations and eollertmg terms, 

hi 4 A:,)c-‘ 4 V 2 4 dAi)c-2' 4 (-lOca - '2c, - dA:* 4 2k,) cos 2l 

4 ( 2 c 3 - 10 r 4 - 2 A -3 - dA^) sin 2t = 0 

\s it stands, w itli all eight ( onstants complctidy arbitrary, this otiuation is not identically 
‘'■Uistied * It will be an identit\ if and only if 


c, 4 A:i « 0 

Hc2 4 3A-2 “ 0 

- lOca - 2r4 - 3A:a 4 2k, - 0 

2cb - J()c4 - 2A-a - 3 A 3 = 0 

1 roni these we find (among many e(|uivalent possihiliticb) 

A'l = -Cl ki “ -? 3 Cz ki = —2(r3 4 C4) k, = 2(ca - c,) 

Hi ri('( , tlie complete solution to our problem is the pair of lunetions 

pi 

X = r,e ‘ -+ r 2 C“^‘ 4 Ca cos 21 f c, sin 2l 4 — 3 

8 c' 

y = ^ r 2 e~^‘ — 2(c8 4 Ca) cos 2t 4 2(ca — Va) sm 2f 4 —^ 4 2 

1 hough tedious, it is fierfectly straightforwnird to m-rify that these expresHions satisfy the hrst 
'>f the original pair of csjuations without additional restrictions on the constants 


* The reason we eneountered no such difficulty m our first illustrative exam¬ 
ple was that we were able to find x from an eouation giving it expluitly m 
terms of y and its first derivative, and did not nave to solve a second differ¬ 
ential equation, thereby introducing additional constants. 
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EXAMPLE 2 

Solve the system of equations 

J)x + (D - 1)7/ + (Z^ + 2)z = 2g‘ 

(D - l)x + I)y -f- (I) - 2)z = ae* 

(D 1 jx + (D - 2)7/ -f (D -f 6)z = 

From the preceding theory \ve expect that the differential equation satisfied hy z is 


I) 

I) -- 1 

1) -i 2 


D 

/) - ] 

2c‘ 

D - 1 


I) - 2 

z = 

D ~ 1 

I) 

flc' 

D 4 1 

I) - 2 

I) + () 


I) -b 1 

D - 2 

e' 


However, expanding the determinants and operating, as lequircd, on the known functions 
2c‘, ae‘, and c', we obtain 

0 z = (a — d)c' (•) 

C’learly, unless a ™ 'I, this eipiation, and hence the systiun .tself, has no solution On the other 
hand, if a «= d, this eijuation is satisfied by any function z In fact, if a = d, it is easy to ve^lf^ 
that the third equation in the given system is eijual to twi( e the first equation minus the si’cor.d 
Hence, when a = d, i-he last I'quution is deyxuKhmt ujion tlie hrst two and is automat k ally 
aatisfied bv any fum tions x(0, //(O. ^it) which satisfy tluun 'Phus, consideimg only tlie hrsl 
two equations, we can write 

J)x 4 (f> - 1)7/ - 2c‘ - (D H 2)z 
(1) - l)x -I- - (I) - 2)z 


and, for every difb-rentiable function z, this system can be solved for x and y Specifically, 


D 

D - 1 


2c‘ - (/> 4 2)z D - 1 

D ~ 1 

1) 

X = 

3r' - iJ) - 2)z D 

C2n - l)x - 2c' 

1 

1 

D 

I) - 1 


I) 2t‘ - {!) 4- 2)z 

1) - 1 

D 

.V = 

j) _ 1 lifi _ (/> -- 2)z 


(I'-i) ( 21 ) - l).v - 3f‘ + (3/; - 2)z 


From Kqs (11) and (12), x and y may be found in terms of z Moreover, smee z is subject only 
to the restriction that it be difTerentiable, it rnav contain any numlxn of arbitiaiy constants, 
and hence, when n — 3, but not otherwise, the solution of the original system may also con¬ 
tain any number of arbitrary constants, as asserted by Theorem 1 


EXERCISES 

With (he understanding that O ^ find a complete solution of each of the following systems 
of lons 

1 (/>-!- r))x + (I) -f 4)j/ » e-' 

(1) 4 2)x f (Z> 4- l)v » 3 


2 (D -h 5)J -h (D -h 3)y - c'' 
(D -h 2)x +(/> + ])!/- 3 



SEC 3.2 THE REDUCTION OF A SYSTEM TO A SINGLE EQUATION 73 

3 {D -H 5)x 4- (D 4- ^)y - c”' 4 (2£) + 5)x - (20 -f •A)y - t 

{2D 4- l)x 4- {D -f l)y - 3 {D ~ 2)x + (D + 2)y « 0 

6 (D 4- 2)x + {D - i)y - 0 6 {D -h l)x + {D + 2)y « 

{2D + 3)x + {3D 4- l)y » 5 Hin 2t {2D -j- 7)x -}-(/> + 10)y - 

7 {2D H- 3)x + (O -f 4)1/ - 0 8 {2D^ 4- l)x 4 (D -f- 2}y = 6 

{D 4 l)x 4 (D 4 2)y = 0 (Z)» - 16)x 4 (/> - 4)|/ - 4 

9 (9DS 4 8)x 4 (3Z)^ 4 4)y = 0 10 {2D^ - D - l)x 4 (£> ~ \)y = 0 

(2/)2 i)j 4- (/J2 2)v = 12 roH 31 (Z)* - l)j 4 (/> ~ D?/ - 0 

11 ("D 4 l)x 4 V 4 2z = 1 

X 4 (D 4 2)v 4 2 = e 4 2 

.'jx 4 1/ 4 (-D — 2)z = 5f~' 4 1 

12 (D - l)x - j/ = / 

-2x 4 {D ~~ l)y - z = 0 

-2v 4 (Z) - l)z = 

13 (D 4 J)x 4 {D ^ 5)1/ 4 {2D 4 5)z = 15e' 

(2D 4 l)x 4 (Z* 4 2)y 4 {3D 4 l)z » 10c‘ 

(/) 4 3)x 4 {3D 4 4)v 4 {4D 4 6)z - 21<*' 

14 {D 4 l)x 4 {D 4 3)1/ 4 (2D + 3)z = 

(2D 4 l)x 4 (D 4 2)v 4 (3D 4 Dz = 0 

[D 4 3)x 4 (3D 4 IDv 4 (47> 4 13)z = I) 

16 (D 4 l)x 4 (D 4 1)1/ 4 (2D 4 3)2 = 0 

(2D 4 l)x 4 (D 4 2)y 4 (3D 4 5)2 = 0 

(D 4 3)r 4 (3D 4 1);/ 4 ( >4 5)r - 0 

16 If (xi,V:) and {xi,y-i) are two solutions of the system 

Pu{D)i 4/’,2(D)i/ - 0 
ru{D)x 4 P2^{D)y - 0 

prove that (fiXi 4 r 2 X 2 , Ci^j 4 Ciy^) is also a solution of this system 

17 Find a system of difTercntial equations having 

X = Ac-' 4 Be‘ 4 Ce^‘ 

?y = - Be‘ 4 2tV^' 

as a complete solution 

18 In Example 1, determine multiples of the two equations v\hu'h, vs hen added, will yield an 
equation expressing y directly in terms ot x and its ^'■anous derivatives Do you think that 
this can be done in general? 

19 Two tanks are connected as shown ii. F4g 3 1 The hrst tank contains 100 gal of pure water, 
the second contains 100 gal of brine containing 2 lb of salt per gal IjKjUid rireulales through 


FIGURE 3 1 



the tanks at a constant rate of 5 gal per nun If the brine in each tank is kept uniform by 
stirring, 6nd the amounts of salt in the respective tanks as functions of time 
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SO Three tanks are connected as shown in Fig 3 2 The first tank contains 100 gal of pure 
water, the second contains 100 gal of brine containing 1 lb of salt per gal, the third contains 
100 gal of bnne containing 2 lb of salt per gal. Liquid circulates through the tank at a 
constant rate of 5 gal per min If the brine in each tank is kept uniform by stirring, find the 
amounts of salt in the respective tanks as functions of time. 


RGURE 3.2 


3.3 

CompUm«ntaiy function! and particular integrals 
for systems of equations 

To illustrate the extension of the ideas of characteristic equation, 
complementJunction, and particular mteyral to systems of 
differential equations, lei us consider the following set of 
equations* 

(I) -f l)x + (D -f 2)7/ + (i) -h 3)2 = + 8/4 2 

(1) (D -f 2)j + (D -f 3)7/ -h (2D -f 3)2 - + 11/ - 1 

(^D -h 6 )j 4- (5/> + 4)7/ -f- (20D - 12)^ = Ic' -j- 2/ 

As in the case of a single equation, we shall first make the 
system homogeneous by neglecting the terms on the right, getting 

(D + l)x + (Z> + 2 ) 2 / + (/> -h 3)2 = 0 

(2) (D -h 2)x + (D -f 3 ) 7 / -h ( 2 D + 3)2-0 

(4D + 6 )x + (5D + 4 ) 7 / + ( 20 D - 12)z = 0 

Guided by our experience in solving single equations, let us now 
attempt to find solutions of this system of the form 

(3) X = ac”' y = fee"** z = 

Substituting these into the equations in ( 2 ) and dividing out the 
common fa(^tor e"*' leads to the set of algebraic equations 

(m + l)a + (m + 2)h + (m + 3)c = 0 

(vi + 2)a + (m + 3)fi + ( 2 m + 3)c = 0 

(4m + 6 )a + (5m + 4)6 + (20m — 12)c = 0 



( 4 ) 
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If nontrivial solutions for x, y, and z, i.e , solutions that do not 
vanish identically, are to be obtained, it is necessary that a, 6 , 
and c shall not all be zero. However, the values a = b = c = 0 
obviously satisfy the system (4) and in general will be the only 
solution of this set of equations In fact, from college algebra (or 
from Corollary 1 , Theorem 7, Sec 10 5) we know that no other 
solutions are possible unless the determinant of the coefficients m 
(4) IS equal to zero Thus we must have 

m+l m 2 rn 3 

m 2 rn -f- 3 27 ti + 3 = — (m — l)(m — 2)(m -- 3) = 0 

4m -f 6 5m + 4 20m — 12 

This equation, which defines all the values of m for which non¬ 
trivial solutions of (4), and hence of (2), can exist, is the charac¬ 
teristic equation of the system It is^ of course, nothing but the 
determinant of the operational coefficient^ of the system equated 
to zero, with D repla(‘ed by m 

From the roots of this equation, mi = 1, m 2 = 2, m 3 = 3, we 
can construct three particular solutions 

I xi = flic' ( X2 = j' X 3 = 03^®' 

yi = 5ic‘ I 1/2 = l> 2 e^^ I ys = 

Zl = CiC' ^ 22 = C 2 C^‘ ^ 23 = CsC^' 

provided that we establish the proper relations among the con¬ 
stants in each of the three sets 

To do this, we note that the (‘onstants a,, hi, Ct must satisfy 
the equations of the system ( 4 ) for the corresponding value m. 
Thus for mi = 1 we must have 

2 ai 36i -}- 4ci = 0 
3ai -f 4^yi -f 5ci = 0 
lOfl] ~|“ 96i -j- Sci = 0 

We know, of course, that the detf'rminant of the coefficients of 
this system is equal to zero Hence these equations are consistent, 
1 e , have a solution other than Oi = 61 = ci = 0, and it is easy to 
verify that, for all values of /t], they arc satisfied by 

ai = —/ci f>i = 2ki Cl =- —hi 

Therefore, for each value of /ci, 

Ji = —kie‘ 
yi = 2/ci6‘ 

Z\ = —ki€* 

IS a particular solution of ( 2 ) corresponding to the characteristic 
root mi = 1 . 
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Similarly, for m% = 2, we have from (4) 

30-2 -f- 4^2 “h 5 c2 = 0 

4a2 4“ 562 7 c2 ~ 0 

1402 4- 1462 4- 28c2 = 0 

and it is easy to verify that, for all values of kzj these are satisfied 

by 

0-2 “ 3A^2 b2 ~ ^2 C 2 ~ ^2 

Therefore, a second family of particular solutions of (2) is 
X 2 = 3 / 026 ** 

(7) t/2 = -/r 26 ** 

Z2 — —/C2e*‘ 

Finally, for m 3 = 3, we have from (4) 

403 4- 56a 4 6 c3 = 0 

5os -f 663 -h 9ca = 0 

I 803 f 1963 -h 48 c3 = 0 

and 03 = 9 A '3 63 = — 6 /C 3 a = —/tj 

A third family of particular solutions of (2) is, therefore, 

2'3 = 9k 26** 

(8) 2/3 = “G/cbC** 

23 = —A: 

Since the equations of the homogeneous system (2) are all 
linear, sums of solutions will also be solution ,"5 Hence we can com¬ 
bine the three families of particular solutions ( 6 ), (7), and ( 8 ) 
into a complete solution of ( 2 ). 

j = 4 - X 2 4 - Ta = —kie^ 4 - 3A:26** 4- 9A:3f^* 

(9) 1/ = 2/1 4- 2/2 -h 2/3 = 2kie* — — OA-jc’'* 

z = 4- ^2 4- 23 = —kie^ — — k^e*^ 

This IS the complementary function of 1 he original nonhomogeneous 
system (1) We note that it contains precisely three arbitrary 
constants, as required by Theorem 1, Sec 3 2 The relations 
among the nine constants originally present in the three par¬ 
ticular solutions ( 5 ) could also have been found by substituting 
those solutions into any two of the equations of the homogeneous 
system (2) and equating coefficients, as we did in Example 1, 
Sec 3.2 

To complete the problem we now need to find a particular 
solution, or “integral,” of the nonhomogeneous system (1) To do 
this, we assume for y, and z individual trial solutions exactly as 
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described in Table 2 2, Sec. 2 3 Thus, in the present case we 
choose 

X = + aa T = + /3a ^ + 72^ + Ta 

Substituting these into (1) and collecting terms, we hnd 
(/3i 4* 27i)e“‘ + (a 2 + 2/02 -f- 872 )/ 

H" (02 4 ‘ 02 H“ 72 d" 0^3 H" 2 j&a 4 * 873) = — 4 8 ^ -h 2 

(«! + 2/3i + 7 i)c ' T i2ct-i -f- 3/^2 “b 872 )/ 

4 " {ot2 02 272 T 2a3 4 ~ 8/3,1 + 87.1) = e~‘ + 11 / — 1 

(2ai — 0 \ — 327 i)e~‘ 4 - (6a2 4 - ^02 — I272)/ 

-b (4a2 4" ^02 d~ 2 O 72 + bora “b 4/^3 — 127 .i) — 7c"' -b 2t 

Clearly, these three ecpiations will hold identically if and only if 
the following sets of conditions are satisfied 

4- 271 = -1 
00) ai + 2/3i 4- 71 = 1 

2at - 01 - 8271 = 7 

a2 d" 202 4- 872 ~ 8 

(11) 2Qr2 d" 8/32 4 " 8s/2 =11 

()a2 “b 4/32 — 1272 = 2 

«2 d" 02 72 d* orj d" 2^j 4" 873 = 2 

(12) oTi d- /32 d- 272 “b 20^3 d- 3/33 -b 873 = — 1 

4^2 4- 8/32 -b 2 O 72 -b 4- 4/3, - 1273 = 0 
biom the set (10) we find without dilliculty that 

«i = 8 = ~1 7i = 0 

From (11) we find tliat 

0^2 = 1 02 = 2 72 = 1 

Finally, from ( 12 ), after the values for a^, 02, and 72 are inserted, 
we find that 

as =- — 8 0'i ~~ I 7 < = 1 

With these values for the constants, the particular integral of 
the iioiihomogeiieous system ( 1 ) becomes 

A' = 8c-' 4- / - 8 1^ - -C-'d- 2/ - 1 Z = / + 1 

Hence, adding these to the respective components of the corniile- 
mcritary function (9), we have the complete solution of the 
original system 

x = -^ic'd- 8A:2e2' + -b 8c-' -f / - 8 

y = 2kle^ — A: 2 C^‘ — — e"' -b 2/ — 1 

2 = —/cic' — k 2 e^* — d" / “b 1 
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EXERCISES 


Find a complete solution of each of the following systems 


{D + 2)x 4- (Z) -h 4)1/ - 1 
(D 4- l)x -h (D -h 5)y - 2 
(D -f l)x -h (4D - 2)j/ - ^ - 1 
{D -h 2)i + (5D - 2)y - 2f - I 
(2D 4- l)i 4- (Z) + 2)y - c' 

(D -H 2)i -f (D + 4)v - e-‘ 


2 (2D -h l)x + (i) + 2)j/ - 0 

(D + 3)t + (Z) + 6)v-3e‘ 

4 (/) 4 5)x + (7) + 7)y » 8c*‘ 

(2D -4 l)i + (3D + l)v - 0 

6 (2D -4 l)x + (D - l)y - cos t 

(D -4 2)i -4 (D 4- 3)y - 0 


7 (2D* + 5)x + (D* -4 3)y - 1 

(D* + 7)x (D* 4- 5)y — f (Hint Assume first x - a cos Xf, y ™ b cos Xf, and then 

X " c sin Xf, y — d sin \t, where X is a parameter to be determined ) 


8 (2D* -4 7)x 4 (D* 4 5)y - c"' 9 (2D* -4 15)i + (D* -4 r2)y - cos i 

(3D* 4- I3)x 4 (3D* + ll)y - 2e-‘ + 12 (3D* 4- 26)x + (3D* + 28)y - 0 


10 (2D 4- ll)x -4 (D 4 3)j/ -4 (D - 2)z - 14c‘ 

(D - 2)x -4 (D - l)y 4 Dz - -2c‘ 

(D 4 l)x 4 (D - 3)y 4 (2D - 4)r - 4e‘ 



CHAPTER FOUR 


Finite Differences 


4.1 

The differences of a function 


( 1 ) 


In the last three chapters we have developed methods for the 
solution of several larj?e and important classes of differential 
equations There are, of course, other families of equations for 
which exact lutions can be found, but in gPJ^eral, differential 
equations more complicated than the simple ones we have been 
considering must be solved by ajiproximate, numeiical methods 
Among the most important of these are what are known as finite- 
diffcrenre methods Since finite differences also occur in other 
blanches of numerical analysis, such as interpolation, numerical 
differentiation and integration, curve fitting, and the smoothing 
of data, it IS desirable that an applied mathematician have some 
familiarity with them, and the present chapter is devoted to this 
end 

Suppose that we have a function y = }{x) given m tabular 
form for a sequence of values of x 


X 

fix) 

Xq 

fix.) 

Xl 

fixi) 

Xj 

fix 2 ) 

X| 

fixi) 


If/(x,) and/(a:,) are any two values of }(x), then the first divided 
differences of /(x) are defined by the formula* 


/(■r■^,XJ) 


f(x,) - f jXj) 
Xy — Xj 


Similarly, if /(x,,x,) and f(xj,Xk) are two first differences of f(x) 


* In most applifatioiis the subscripts of the arguments x, and ij will be 
consecutive integers, but this is not a necessary restriction on the definition 
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( 2 ) 


having one argument, Xj, in common, then the second divided dif¬ 
ferences of f{x) arc defined by the formula 


f(x„X„Xk) 


/(j-.,!,) - f(Xj,Xk) 
X, — Xk 


Ihoceeding mdu<‘tjvely, a divided difference of any order is 
defined as the diffeiem'e between two ilivided difTerences of the 
next lower order, overlajiping in all but one of their arguments, 
divided by the difference between the extreme, or nonoveilapping, 
arguments a|)j)eanng m these differences * Fiom these definitions 
it IS clear that divided differences have the following })ro])erties 


PROPERTY 1 

Any divided diffiu'cnce of the sum (or diffeience) of two functions is equal to the 
sum (or difference) of th(‘ divided difTerences of the individual functions 

PROPERTY 2 

Any divided difference of a constant times a function is equal to the constant 
times th(* divided difference of the function 

In many applications it is conv'enieni to have the divided 
dilfcH'iices of a function prominently disjilayed d'his is usually 
done t)y constructing a difference table in whicli each ditference 
1 ^ entered, in the apiiropnatc* column, midway between the ele¬ 
ment > m the jirecediiig column from whicli it is constructed 

^ f(x) 

ro /(to) 

firo,Ti) 

ri f(xi) fixo,xi,x^) 

f{Xo,Xi,X^,X») 

Xz fixz) fixt,Xz,Xi) 

/(X2,X3) 

X, /(X 3 ) 

or m a speeific numeneal example, 


X 

X" 




0 

0 




1 

1 

1 

4 




13 

1 


3 

27 

37 

K 

1 

(i 

4 

64 


14 

0 



93 

1 


7 

343 

193 

20 


9 1 

729 





* Though obvious only for divided differences of the hrat order, it is true (sec 
Exercises 13 and 14) that divided differences of all orders are symmetric func¬ 
tions of their arguments Thus, /(a:„Xj,Tfc) */(i„x*,jj) «/(x,,J.,Xt) * 
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Ci) 

(i) 

(.')) 


Usually Iho values of x in a table of data will be equally 
spared, and the differences of the function will be based on sets of 
consecutive functional values When this is the case, the denoini- 
nators in the divided diffeienccs of any given order are all the 
same, and it is customary to omit them This leads to a modified 
set of (piannties known simply as the differences of the function 
If the constant difference between successive valui's of x iS h, so 
that the general value of x in the table is 

Xk - o-o + u A - . -2, -1, 0, 1, 2, 

and the corresponding functional value is 
Vk = J(xk) = f(ro kh) -- fk 

I hen the first differences of / are defined bv the formula 


^fk — fk^ I — Jk 

Differences of liighei oidei art' defined in the ^aine way, the 

second differences being 

AVfc = A(A/a) = A/*4t - 

and, in geneial, foi positive integral values of ri, 

^-^k - = A'* '/hi - A--'A 

These differences are also displayed in difference tables just like 
divided differeiiCes 

Evidently the difference operator A has the characteristic 
juopcities of a lineal operatoi, for 

Mfk ± (Jk) =' ifk+i ± Qkn) - Uk ± Qk) 

^ (4+1 - 4) ± {gkM - (Jk) = A4 ± Agk 
and, if r is a constant, 

A(c/a) cfkA-i - rfk = r{fkM — fk) =- c A/a 
Aforeover, A obeys the usual law of ('\ponents 

A”‘(A".4) =- A'”+"/a 

piovided both 7n and n are positive integers 

Wlien the values of the indept'ndent variable are (‘qually 
sjiaced, tlip divided differenet's ol a function can easily be ex¬ 
pressed in teims of ordinary differences and vice versa 
Speeifieally, 


y \-l o,J 1 j _ h h 

Co — X2 2h\ h 

and, m geneial, 

!{x..r,, ,«■-)= A/; 



2’/i = 


Moie gf'iK'rally, if the j^oints used in ronstructing an nth divided 
difference are the n -\- i equally sfiaced points between Jo — kh 
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and aro -h (n — k)h, indusive, it is easy to show that 

(7) 

The A syinbolihin for the differences of a function is known as 
the advancing difference notation. In some applications, however, 
another notation known as the central difference notation is more 
convenient In this, the symbol 5 is used instead of A, and the 
subscript afipeanng in the symbol for any difference is the 
average of the subscripts already assigned by this convention to 
the elements^ which are subtracted in foiming that difference 
Thus, 

A/* = ~ Jk ~ Afv+l =- //c 42 ~ A+1 = Sfk+h 

A^fk = Afk^i — Afk = ~ 5^*41 


The following differenci* tables show the relation between the 
advancing and the central dilfei*ence notations 


X 

f 



X 

f 




Xf) 

1 /n 

A/o 


X(' 

7. 






AVo 


ri 







A/. 

A’/o 





«’/!4 

X-i 

h 

A^fi 

A Vo 

Xi 

/-■ 






A ^2 

AV. 

1 

1 





Xi 

f 3 

A»/2 


X ^ 1 



fiV3 




A/b 




6f7, 



Xi 

u 



Xi 

fi 





In the first, elenn'nts with the same subsennt lie on lines sloping 
downward, or cif/vanrifuj into the table In the second, elenn'iits 
with the same subscrijit he on lin(‘s extending horizontally, or 
renlrall/j, into the table 

Closely associated with A and 6 is the operator A’, whnh is 
defined as the operator which increases ttu* argument of a func¬ 
tion by one tabular interval Thus, 

— f(j.'k T /?) “ f(rk+i) ~ //c4i 

Atiplvmg E a second time again increases the argument of / by 
h\ that is, 

E^fiXk) = E[Efi.ik)\ = Efixk + A) = fivk + 2h) = /(^,^o) = fk^, 

and, in general, w’e define 

W fEf(Xk) = f{xk + rh) = /(j-Mr) = fk + r 

for any real number r Clearly, E obeys the laws 
E{fk ± gk) = Efk ± Egk 
E(cfk) = cEJk 


c a constant 
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Two operators with the property that when they are applied 
to the same function they yield the same result are said to be 
operationally equivalent Now, from the definition of A/*, we have 

A/* = ~ fk - Efk — fk 

or, symbolically, A/* = (E — l)fk 

Hence, we have the operational equivalences 

(9) A = E - I 

( 10 ) E = 1 -h A 

(11) E - A = \ 

Moreover, by definition, 

A/fc = = SE'^fk 

Hence, we have the further equivalences 

(12) A = 5E^^ 

(13) 8 = AE-^^ 

Also, substituting^ from (12) into (9) and solving for 5, we have 

(14) 8 = E?^ ^ E-^^ 

By means of (9) wc can express the various differences of a 
function in t ms of successive entries in the table of the function 
For we can write 


A"A = (E - l)-fk 

and then, using the binomial expansion, 



-t (—1)"‘ ^vEfk ( —l)"/jt 

(15) = fk-\.n — nfk+n^l -h ^ ^ 2 “H 

F (--i)’‘-'/^/*H (-1)"A 

Specifically, taking k = 0 and = 1, 2, 3, 4, , we have 

A/o — fi ~ fo 
A^/o = /2 - 2 /i + fo 

(15a) AYo = /3 - 3/2 -f 3/i - fo 

AVo — f\ — 4/3 d- fi/2 — 4/1 -h fo 


t The quantities are the so-ealled binomial coefficients, defined by the 
formula (;) - 
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The fact that the first divided difference of a function is pre¬ 
cisely the difference quotient whose limit defines the derivative of 
the function suRRests that in some respects the properties of the 
differences of a function and the properties of the derivatives of 
a function may be analogous This is actually the case, and among 
other interesting results we have the following- 


THEOREM 1 

The nth divided differences of a polynomial of degree n are constant 

PROOF To prove this theorem, it is clearly sufficient to establish the asserted 
property for the special polynomial To do this, we observe that for the first 
divided difference is simply 





xr ‘ + :r," ^Xj + 


+ x.Xj^-’^ -h ^ 


which IS a hrmogeneoiis and symmetric function of x, and Xj of degree n — J for 
the second divided difference we have, of course, 




X. - Tfc 


Moreover, since divided differences of all orders are symmetric functions of their 
argume» ‘ < (sec' the footnote on page 80), it follows that the numerator of the 
last fraction vanishes when a — Xk Hence, it must contain j, — Xk as a factor, 
and, thenffon^ as we verified explicitly for the first divided difference, the indi- 
(*ated division is exact 7'hiis the second divided difference of j" is a homogeneous 
and synimetm cxproN'^ion of d**grec n ~ 2 m .i,, Xj, and Xk Continuing in this way, 
it is evident that, after differencing Ji times, the degree of the resultant expression 
will be zero, that is, j” will have been reduced to a constant independent of 
j:,, Xj, .u, . . , as asserted 


Since ordinary differences are proportional to the correspond¬ 
ing divided differences, it is clear that Theorem 1 also holds for 
these differences whether they are ex[)rcssed in terms of the 
advancing or the central difference notation. Thus we have the 
following corollary of Theorem 1' 


COROLLARY 1 

The ^th (oidinary) differences of a polynomial of degree n are constant 

The analogy between differences and derivatives becomes 
even more striking if we consider the operator A and introduce the 
so-called factorial polynomials: 

(16) (xY-^ = x{x - 1) (j- - n + 1) 

=-- 1 _ 

^ ^ (z + l)(i + 2) (x + n) 

In general, these play the same role in the calculus of finite differ¬ 
ences that the power functions x" and x~'^ play in ordinary 
calculus In particular, we have the important formulas 


(18) 

(19) 
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( 20 ) 


( 21 ) 


( 22 ) 


whose resemblance to the formulas for difFerentiatiiig; .r" and 
Ls unmistakable The proofs of these involve only a little ele¬ 
mentary algebra, and we shall leave them as exercMses 

In view of Formulas (18^ and (10), it is a matter of some 
interest to be able to express an arbitrary polynomial p(x) of 
degree ri in terms of factorial polynomials One way this can be 
done is to WTite, by analogy w'lth Maclauriids expansiori, 

p{x) = «« -f Oi(r)f^^ H- 02 (r)^ 2 ) ^ 

where, clearly, since j)(2) is of degree n, no terms beyond 
need be included If we set r = 0 in Kq (20), every i«nm after 
the first becomes zero, since each contains t as a tactoi Hence, 


«o = /)(0) 

Now if we use (18) to take the fust differein^e of p( r), as given by 
Eq (20), we get 

Ap(x) = ai + 2 a 2 (x)^^^ + 3a^(x)^^' d- + /'ian(r)^'‘"‘' 

and, if WT set z ~ 0 in this expression, we obtain 
ai = Ap(0) 


Differencing again, w^e hud 

A=/i(r) - 2’a2 -f d 2a.(r)<'^ + ?i{n - l)a.(j 

and, evaluating at = 0, 

_ A2p(0) 


Continuing this process of differencing and evaluating at .7 = 0, 
we obtain the general formula 

aj = j = 0, 1, , n 


which obviously resembles closely the familial formula for the 
coefficients in Madaurin's expansion This ])rocedure is especially 
convenient when we aie given a diffcrenee table of the poly¬ 
nomial rather than the polynomial itself 

When we are given the polynomial itself, it is usiially ineffi¬ 
cient to construct a difference table and apply the preceding 
method Instead, it is better to proceed in the following way If 
we divide p(x) by x we get a remainder ro (which is just the 
constant term in p) and a quotient go(x), so that we can write 


p(x) ^ ro d- xgo(x) 

Now, if we divide go(x) by x — 1, we get a remainder ri and a 
quotient gi(x) such that 


go(x) = n d- (x - l)^i(x) 
Hence, substituting into (22), 


p(x) = ro d“ x[ri d- (x — l)gi(x)] = ro d- ri(x)f*^ d" x(x - l)^i(x) 


(23) 
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If, further, we divide by j — 2, we obtain a remainder r* 

and a quotient that 

rvi(x) = rj + (.r - 2)(/j(r) 

and, substituting into (2.3), 

p(.i) ro + + -r(j' - l)[r2 + (i - 2)(/2(j.')] 

= 7-0 -f- -h -h J-(r - l)(.r - 2 )^ 2 (-r) 

Each application of this procedure leads to a now quotient whose 
d(‘gree is one less than the degree of the preceding cpiotient 
Hence, the ))ro(‘ess must terminate after // -f- 1 steps with the 
lecpiired e\[)ansion 


p[i) ^ r,, -h ri(r)^’^ -f -h 


“h r„ i(r)^” + r„(r)^”’ 


Obviously, the recjuin'd divisions < an easily he carried out by the 
elementary process of synthetic division Moreovei, it is clear 
from F]qs (20), (21), and (24) that 


- aj - 


A-'p(O) ==j’r, 

Hence, thi^-' method provides a convenient way of constructing 
the difference table ol a polynomial in the important case when 
// = 1, Slime it furnishes us \\ith the leading entry in eac'h column 
of the table and from these the table can be extended as fai as 
desired tiy simple addition. U'-ing the identity 

"h 


ExpreRB p(j) ^ jr* - '■jj-* 4 3 j- -}- 4 in terniH of fHctonnl j)oh normals and construct tin* differ¬ 
ence tahl(' of the function for /j =* 1 

Using synthetic division wc have at once 


Ttic remainders r„, ri, rj. rj, r 4 are the underscored iiurnhers 4,-1 — S, 1 1 Hence 


p(j) ss — Tij-* 4 dj- -f 4 

I can be verified by direct expaiiaion 
Now from (25) we have 




A*p(U) - 6 AXO) “ 24 
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Hence we have the leading entries in the difference tabic for pfx), and by "crisscross” addition, 
jis indicated, the table can bo extended and the values of p(a:) determined as far os may be desired 


j p{j) A A* A’ A* 



Once a function has been expressed as a series of factorial 
polynomials, it is a simple matter to apply Eq. (18) or (19) to 
obtain its various differences Conversely, when a function has 
been expressed as a senes of factorial polynomials, it is easy to 
use these eciuations “in reverse” and find a new function having 
the given function as its first difference Hy analogy with the 
terminology of calculus, we shall refer to such a function as an 
antidifference. 


EXAMPLE 2 

U hfit js (he general antidifTcrencc of the polynomial p(t) = t* - Tia** -h Hjt + 4^ 
From the results of Example 1 wc know that 


P(t) = + 4 


H(Mice, from Eq (18), it is clear that the required aiitidifTerencr, which jb often denoted by the 
iiibol A~'p(t), is 


A ^p(x) 


(x)(^ 

5 ^ IT 


8(r)^ 

3 


(xy“ 


-h 4(x)(‘) -I- c 


where c is an arliitrary constant which can, and in general must, be added, since the difference of 
any constant is obviously zero The analogy between antidifferences and indefinite integrals 
or antidenv'ativcs is clear 


The determination of antidifferences is not just a mathe¬ 
matical curiosity, but is intimately related to the important 
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problom of finding the .sums of .series To .see this, con.sider an}' 
two consecutive columns in a difference table 

A‘/i 

A‘/2 

A *+>/2 

A ‘/ t , 

A'-+‘/. 

A‘/n.-l 

Now, fiom the definition of a difference we have 

J A-'+'Z. = (AV 2 - AVi) + (A‘/3 - A‘/2) + 

1-1 

+ (A"/,, - A*/., . 1 ) + fA*/nHi - A'‘/„) 
or, cancf'luig the conimoii teiiiis in the senes 011 the light, 

(2f)) V A-'+'Z. =• AV-m - A*/, 

1 

Snu'C tfio ki]\ differonco of a function is obviously an antielifTcr- 
ence of the {k -f- l)st difference, it is clear that Kq (26) is equiv¬ 
alent to the following theorem 


THEOREM 2 

If F(i) IS any antidiffeieiice of f(i), then the sum from i = 1 to ? = a of the 
senes whose general term is f{i) is F(n 1) — /'’(I) 

The analogy between this theorem and the fundamental thooiein 
of iiitegial calculus is unmistakable 


EXAMPLE 3 

What la llio aum of the Htiuurea of the first n odd integers'’ 

To fanlitiite I lie fiiuhnR of the necesHai> antidifTereiice, we IiihI express the geneial Icrin 
of the series, namelv, V2i — 1)*, in terms of fuetorial polynomials 

(2i - ly - 4i(i - 1) T 1 * 4(i)<» -I- 1 
Then, b> the last theorem, 


I i2^ - 1)> 
1-1 


n 

^ + 1 ) 
1-1 


4(^)(3) 

"3 


i (7)0) 



4(n -h !)(*) 4(1)(‘ 

—3 — + (n 4- 1)0) - 


(1)0) 


4(n -f l)n (n - 1) 

3 “ 


-H (n + 1) - 0 - 1 


4n* — n 
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1 Prove Formulas (6) and (7) 2 Prove Formulas (18) and (19) 

3 Express the following polynomials m terms of factorial polynomials, and construct a differ¬ 
ence table for each function 


I* — a; + 1 


b X* — 2x’ — X 


c x“ — 2i* -h 4x* — X -f- 6 


4 For each of the following difference tables, find the polynomial of minimum degree which 
yields the given data. 


I 

y 




X 

y 





0 

-1 

-1 



b 0 

6 

-5 




1 

-2 


6 

6 

1 

1 

-3 

2 

-~G 


2 

3 


12 

0 

2 

„ 0 


-4 


24 



17 


G 



-7 


18 

0 

.3 

20 

3.5 

18 


3 

-0 

7 

14 

42 

24 

4 

55 




4 

-2 


56 




6 If = 1, show that, for all values of the constants a and h, each of the following functions 
satisfit'b t he indicated relat ^n 

A y = a2^ + b3’ (E^ - 5E + 0)v “ 0 

b 7/ = a2* + /ix2' (F* - 4F 4)y => 0 

c 7/ = a.'P -f- ^( —2)* (A® -f A — (j)y *= 0 

6 Find the .sum of the cubes of the first n mtegerb 

7 Show that Mf„gn) = + QnAfn == Qn^^^fn 4 fn^Un 

8 If /i »= 1, show that A sin ax =» 2 sin ia/2) cos n(x H- that 

a 

A cos ax “ — 2 sin ^ sin a(x -h 

9 Express each of the following in terms of factorial “polynomials” of the type (x)“'*^ 


(x -f 2 )(x + 3 ) 


(X -h l)(x 4 2 ) 


(X + l)(x 4 3) 


What 18 y- - --? 

4 (k 4 - 1 )( 4 ' -{-2){k + 3 ) 


11 Show that (x)^“’(x)(''^ 7 ^ but that (x 4- ■» (i 4- 

n 

V F'* — 1 

12 a Show that y yk “ — ;- y\, and then, by putting F « 1 4- A, show that 


2 f nen - 1) ni 

y* - f n + .i +- 

Jfc-1 L 

b Using the results of part a, evaluate X 


(71 - 1) ^ , n(n - l)(n - 2) 

-A 4- --■A* -h 

2’ 3! 
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18 Show that/(io,xi) “ /(xo)/(io — ii) -f/(^O/Ui — lo) and that 

. . __.__+__ 

10,2:1,2:2 ^ j,)(to — Xi) (Xi - J-o)^! - Xi) {X2 — Xo)(X2 - Xi) 

What 10 the generalization of these lesults to divided differences of higher order? 

14 Show that 

|/( 2 :o) /( 2 :]) I 


f{Xo,X,) » 

^ • 1 

To 2-, 1 

1 1 1 


and that 



/Uo) fiXr) 

f(x.) 

/(2:n,Xi,T2) ” 

Xo xi 

1 1 

Xi 

1 

To* Ti* 

T;“ 



To Ti 

T2 


1 1 

1 

What IB the generalization of these leaults to divuleil differences of higher order? 

15 If wc define ,x 

„_j,T„,Tn) = 

lim f(xo,ri, ,T„ i,Tn,T), show that 

r— »Xn 



dfixo.ci, ,x„ i,t)| 

,T, i,T,.,Tn) 

(ix |x = Xn 


4.2 

Interpolation formulas 

One of the most important a|)plu*atioiis of hnite ciifTeieiiccs is to 
the problem of int(‘ipolatioii in (•ouls(•‘^ such as algebra and 
tngonometiy, where tables of the eleuu'iitary luiictioiis must 
oecasioiially be used, it is eustomaiy to obtain values between 
adjacent entiles by the method of piopoitional parts or linear 
interpolation As is well known, this pioecdure amounts to 
replacing the are of the tabulated function ovet one tabular 
interval by its chord and then reading the nspiiied functional 
value from the chord lather than from the aic itself (Fig 4 \n) 


FIGURE 4 1 

Straight dine and 
parabolic ap¬ 
proximations to a 
given function 



(a) 


(W 
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a) 


^2) 


(3) 


In this case the formula for the interpolated value turns out to be 
/(jo -h rh) = f(To) + r[/(xo + /i) - /(.To)] = /o -h r A/o 

Obviously, if h is relatively large or if the graph of f{x) is 
changing direction rapidly, the chord may not be a good ajiproxi- 
mation to the arc, and linear interpolation may involve a sub¬ 
stantial error One way to overcome this difficulty would be to 
approximate the grajih of /(r) by some cuive which would “fit" 
the true arc more closely than a straight line could and then read 
the inter]lolated value from this approximating curve rather than 
from the choid (Fig 4 \h) If, specifically, the graph of /(r) is 
aiijnoximated over two successive tabular intervfils by a parabola 
of th(' form y — « -f- hr + cr^ ( hosen to pass through the three 
])Oints 

[‘To, /(ro)l |ro -h h, /(.ro + /i)] [.ro -F 2/i, /(ro + 2h)] 

the formula foi the mterjiolated value is found without difficulty 
to be 

fixo + r/i) = jUa) 4- r[/(.ro -f /i) - /(xo)l 

+ (/(Xo + ‘Zh) - 2/(r„ + A) + fix,)] 

- /o + r A/„ + A»/„ 

I’roceeding in this fashion, using polynomial curves of higher 
and higher order to apfiroxirnatc the graph of f(x), one could 
derive a succession of interpolation foimulas involving higher and 
higher differences of the tabulated function and jiroviding m 
general higher and higher accuracy in the mterjiolated values 
In this section w(‘ shall obtain sevei-al imjiortant interpolation 
formulas, though we shall derive them by methods more gener^, 
than the geometric apjn'oach we have just suggested 

Probably the most fundamental interpolation formula is 
Newton’s divided-difference formula : 


/W = f(^o) -F (r — Xo)fixo,xi) + (j: — to)(x — xi)f(xo,xi,X2) -F 

d- ( 2 : — Xo)(x - Xl) ■ (x — XnM)f(Xo,Xl, ,Xn) 

-F (r — Xq)(x — Xl) ■ ' (x - Xn)f{x,Xo,Xi, ,Xn) 


From this all the other mterjiolation formulas of interest to us 
can easily be derived by suitably specializing the points xo, 
Xl, , Xn, which need not be regularly spaced or taken in 

consecutive order For conveuience m establishing (3) we shall 
restrict oilt discussion to souRe special, though adequately typical, 
value of n, say n — 2 Then, beginning with the third difference 


/(X,X0,X1,X2) 


. /|ii|ro,xi) ^ /(xo,xi,X2) 


X — Xj 
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and solving for /(x,i:o,j^i), we have 

(4) fix,Xo,Xi) = f(Xi),Xi,X 2 ) + (t - X 2 )J(x,Xo,Xi,X 2 ) 

X r/ . f{x,Xo) - /(^0,-ri) 

But J{x,Xq,Xi} =-- 

X X\ 

and, substituting this into (4) and solving [or }{x^Xq), we find 

(5) /(^,To) = /(-TojJi) -f (-r - ri)/(a-o,Xi,j- 2 ) (x - -ri)(j:- - Xijfix,ro,ri,Xi) 

finally, since f{r,xo) = - - 

J" — Jo 

we have, on substituting this into (5) and solving for/(j), 
f(x) = /(xo) + (j - Jo)/(jo,Ji) + {x - Jo)(j - Xi)f{xo,U,X 2 ) 

+ (j - Jo)(j - Xi)(j - X2)f(x,Xii,Xi,X2) 

which IS piccisely Kcj (IS) in tlie special case ri = 2 The extension 
of the preceding argument to any value of n is obvious 

The last term in (dj differs fioin the other terms in that (he 
divided difTcrence ap))earing in it contains x as one of its argu¬ 
ments wnd, hence, is not to be found among the enliies in the 
diflercnce table of /(j) For thi*^ reason the last term is usually 
releired to as the remainder after n -t 1 terms or simply as the 
error term, and the interpolation senes is often written in the form 

(B) /(j) "" 7>n(-r) + r„,iix) 

where, of cuurse, is the nth-degree polynomial 

(7) /(jo) T (j - Jo)/(jo,Jl) -T (j - Jo)(x - Jl)/(jO,Jl,J‘2) + . 

-h (j — Jo)(j — Xl) (t - Tn- l)f(Xo,Xl, ,Jn) 

and rr,^i(j) is the function 

( 8 ) (j — Jo)(j — Jl) (j — Xn)f(x,Xo,Xi, . ,J„) 

Using ((i), (7), and (8), it is possible to obtain an interesting 
alternative expression for an nth divided difference and ulti¬ 
mately a somewhat more tractable form of the remainder term in 
(3) Tt) do this, we observe that rn 4 i(j) vanishes at least n \ 
times on the closed interval between the largest and smallest 
values of the set (ro,Ji, ,J«), since, in fact, it vanishes when 

X = Jo, Jl, , Xn Therefore, assuming that the necessary 

derivatives exist, it follows from Rolle’s theorem that 
must vanish at least n times on this interval, r^,+i(j) must vanish 
at least n -- 1 times on this interval, and, eontimiing in this 
fashion, rJ,”\(j) must vanish at least once on this interval That is, 
there must exist at least one value of j, say j - between the 
largest and smallest values of the set (jo,Ji, ,Jn), such that 

^ Hence, differentiating (6) n times and evaluating the 
result for x — f, we have 

= 0 

Now, from (7), the leading coefficient in the nth-degree poly- 


( 9 ) 
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( 10 ) 


m 


nomial pn(^) is /(xo,a:i, . . ,x„) Therefore, 

n\f{xo,xi, ,j„) 

and, hence, from (9) we have, for each value of n, 

f(xo,xi, ,Xn) = 


where ^ is somewhere between the largest and smallesi values of 
the set (j:o,xi, ,Xn) 

Applying (10) to the (n + l)st divided difference appearing 
HI the expression for r„ 4 i(x) in (8), we have, as an alternative 
form of rn-t-i(x), 

/(n+n^'t) 

rn+i(j) = (r - Xo)(x - Xi) (i ~ j-„) ■: -r"i\7 

(n + 1)’ 


where now f is somewhere between the largest and smallest 
values of the set . . ,t,i) The error torin r,i|.i(r) is of 

great importance in theoretical studies of the convergence of the 
interpolation senes (It), but the dithculty of estimating the factor 




’ (n-hl)’ 


often limits its usefulness in numerical work Of course, if f(x) is 
a polynomial of degree m, say, its divided differeiKTs of order 
greater th. ' m are all exactly zero, and, if we extend the senc.-^ (.'■}) 
sufficiently far, the error term will be zero In our work we shall 
neglect the error term in (3) on the assumption that, eventually, 
the divided differences become exactly zero or at least negligibly 
small, and that the senes is extended to this jioint 


EXAMPLE 1 

Find f(2) from tlie following data 


T 

/U) 

f(l,,Tj,Xk) 

fiz„Tj,Tk,Xl) 

-1 0 

3 (K)0 




-5 (KM) 



0 0 

-2 000 

5 500 



3 250 


-1 000 

0 5 

-0 .375 

3 500 



6 750 


-1 000 

1 0 

3 000 

1 000 



8 750 


-1 000 

2 5 

16 125 

-1 5(K) 



5 750 



3 0 

19 000 




The construction of the difference table presents no problem, and, using Newton’s formula, 
with xo “ 0, we can write at once 

/(2)-2 000 -h (2 - 0) (3 250) + (2 - 0)(2 - 0 5) (3 500) 

-h (2 - U)(2 - 0 5K2 - 1)(- 1 000) 

- 12000 
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In passing^ we note that the ordinary process of linear interpolation yields the value f(2) ■■ 
13.750 


( 11 ) 


Closely associated with Newton^s divided-difference formula 

IS Lagrange’s interpolation formula,* 


fix) = 


( x - Xi) ix - Xg)_- (x - J„) . 

(xo ~ Ti)(xo - X2) • * (xo — xO ^ ^ 

4. (x - Xo )(x - X2)_(x - X„ ) 

(xi - Xo)(Xi — X2) (xi — XnK ^ ^ 


+ ’ ' .... 

4. ~ xi) - Xn -i) 

(j-„ — Xo)(jn — ■ ■ (Xn — 


Like Newton's divided-difference formula, this formula provides 
the equation of a polynomial of degree n (or less) which takes on 
n -h 1 I’rescribed functional values when 1 takes on the values 
Xo, J u . ,JLn Equation (11) can easily he derived from Eq (3), 
hut it is simpler merely to verify its properties Clearly, it is a 
[lolvnomial of degree n (or less), since each term on the right is a 
polynomial of degree n ^doreovei, when f - xo, every fraction 
except the first vanishes hecause of the factor x - lo. and at the 
^ame time the first fraction reduces to 1, leaving just J(j) ~ /(xo), 
as required, when r = X(»' In the same way, wlien i — .ii, every 
fraction except the second heeomes zero, and we have f(i) = f( 2 1 ) 
Siniihirly, we can verify without difhculty that fit) reduces to 
/(X 2 ), /(Xj), . ,/(Xn) when x = x^, 13 , , u, as requiied 

When the [.Hunts ri, . , x„ on which Newton's divided- 

diffc'rence formula i.s based are regulaily spaced wnth tabular 
interval h, say, it is generally more convememt to exyiress Foi mula 
(3) in terms of ordinary diffeiences To do this we observe that if 


r = To T rh and x* = Xo T 


( 12 ) 

(13) 

(14) 


then c — x/f = h(r ~ k) A: = 0, 1, 2, n 
and 


(x - Xo)(t — Xi) - (r - X;) = h^+^r(r - 1) * (r — j) 
Also, from Eej ((i), Sec 4 1, we have 

/(rti.-Ti, ,.T,+,) 

Hence, substituting from (12) and (13) into (.3), we find 
fix) = fixo -h rh) 


= /o 4- r A/o + 


rjj - 1) 

2» 


A=^/o 4 


r(r- l)(r- 2) 
3» 


AVo 4 - 


which is known as the forward Gregory-Newton interpolation 
formula.t Obviously this is a direct generalization of the formulas 
of linear and parabolic interpolation [Eqs (1) and (2)] Of course, 
the error term in (3) can be transformed into a corresponding 


* Named for the French mathematician Joseph Louis Lagrange (1731>-1813) 
t Co-named for the Scottish mathematician James Gregory (1661-1708) 
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error term for the series (14), but we shall leave this as an 
exercise. 

For tables of limited extent, Formula (14) is (‘specially 
adapted to interpolation near the upper end, i e , for smaller 
values of j:, and cannot conveniently be used near the lowei 
end For the latter case it would be desirable to have a formula 
iisniK differences located above rather than below the point of 
interpolation Such a formula can easily be derived by choosing 
the points xo, /i, , Xn used in the divided-difference formula 

(H) to be the points 

.ro, J (1 — hy Jo — , Jo — nA 

Then r — r* = h(r k) k — 0, \, 2, , r/ 

and 

(l-'i) {x — J())(j - fi) (x — jJ = h^-^W(r 4- 1) ’ (r 4-j) 

Moreover, in tins case the typical difference 

/(tn,Ji, yXj^i) 

becomes /(jo,t._i, 

and, from the symmetry of divided differences, the last expression 
IS (‘qiial to 

fix-, \,X-„ ,Xo) 

Hence, u. .ng K(i (7), Sec 4 1 (with ri ^ k = j ^ 1), wo have, 
for our current choice of points, 

1 

(lb) /(.r(),Ji, ,0+i) = 

Hence, substituting from (In) and (16) into (3), we find 
(17) fix) ^.f(x,-hrh) 

= fo + r A/_, + Ay -2 

which IS known as the backward Gregory-Newton interpolation 
formula. 

EXAMPLE 2 

Compute /(] 03) from the following data 


X 

fix) ^ 


A" 

1 00 

1 (KJOOOO 




0 257625 



1 05 

1 257625 

0 015760 



0 273375 


0 000750 

1 10 

1 531000 

0 016500 



0 289875 


0 000750 

1 15 

1 820875 

0 017250 



0 307125 



1 20 

2 128000 
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The construction of the difference table presents no difficulty, and we need merely identify 
Z% 1.00, — 0 05, r =» 0 6 and then substitute into Formula (14j 

/(I 03) - f[\ (K) + (0 6)(0 05)] 

- 1 000000 + (0.6)(0 257C25) + 1—(0.015750) 


(0 6)(0 6 - 1)(0 6 - 2 ) 

—^--(0 000750) 


1 152727 


Linear interpolation uses only the first two terms of the last senes and hence yields the (presuma¬ 
bly) less accurate value/(I 03) = 1 154575 


There are various ways of oiitaining central-difFcrence 
iriterpolatioii formulas For instance, we can clioose the points 
used ill Xewton's divided-differcnee foiinula in the following 
order 


Xq — Xo 


(18) 


(18a) 


Ji = xa h X2 = xo h x^ = Xq 2h Xa iq — 2h, 

Then substituting into (3) and using (7), See 4 1, to simplify 
tlie vanous divided dilTerenees, we hnd 

f(jL) --/(jo-f r/i) 


. /. + r A/. + 'I' - '> A>/., + ~ y A./-, 


or, introducing the central-difTerence operator S by means of the 
operational equivalence A — 5/^^^ [ICq (12), Sec 4 1], 

/(j„ + r/i) - /„ + r 

(r + l)r(r - l)(r - 2) 

+ - -- - S/o + 


This IS known as the forward Newton-Gauss interpolation 
formula. 


•ro xo 


In exactly the same way, by choosing the points ro, Ji, 
.r 2 , . in the order 

xo — h .r2 = 4*0 -h Xi ~ Xo — 2h X4 = xn 2h, . 

and again substituting into (3) we obtain, after introducing the 
central-difference notation, 


/(ro rh) = /n “h r 5/_v4 + - 
-h 


(r + l)r (r + l)r(r - 1) 

6 Jo H--. 3 — — 6 J_^i 


2» ' 3! 

(r -h 2)(r -h l)r(r - 1) 

41 ' 


5^0 “h 


( 19 ) 
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which IS usually referred to as the backward Newton-Gauss 
interpolation formula. 

If we take the average of Eqs (18a) and (19) we obtain a 
useful result known as Stirling’s interpolation formula:* 

(20) f(xo + r/i) = /„ + 

r(r* - 1) r=(r2 - 1) ^4. , 

+ - - - -2- + —41 — + 


Another formula of considerable utility can be obtained by 
ehniiriating the differences of odd ordei from K(} (]8ff) by means 
of the fonnulas 6/,^^ = fi — — 5 “/d, . Thisgives 


f(i{) + rh) -- fo “b i'(fi -- fo) -|- 
(r -f l)r(? - 


4 




rir - 1) 

21 ■ 


+ (V_+ 2)(r + I Wr - IHr - ‘2) ^ ^ 

O' 


or, collecting terms, 


f(ro 4- rh) - - (r - l)/o - 


r(r - 1)(7 - 2) 


S’ 


- 5^0 


(r -f ])r(7 - 1)(7 - 2)(r - :-}) 

-- -- - -6/„ 


(r + l)r(r - 1) 

+ rf^ -b - 4 ^, 


(r 4 -4(r 4 3)r(r - 1)(/ - 2j 
+ - - , - ■ - Sf,+ 


( 21 ) 


binally, if wc set 1 — r = m tlu* coeflic lent.s of the difTerences of 
fo, we obtain the symmetric form 


/(ro -f rh) = .s/o 4- 


s(.s2 - 1) s(.s2 - l)(.s2 ^ 4) 

' .S’ ^/n"r ■ - “ 


SVn 4- 




r(r^ — 1) 


-b 


r(j^2 


- I)(r2 - 4) 

-V,— + 


which IS known as the Laplace-Everett interpolation formula. 


EXERCISES 

1 E.stalilish Eq (2) b> GndinR the equation of the approximatinR parabolfi and e valuating 
it at X “ Jo 4 rh (Hint Take Jo, -Ti, Ji to be 0, h, 2h, Te8]X'rtively ) 


Named for the Scottish mathematician James Stirling (1692-1770) 
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2 Obtain the error terms in the forward and backward Gregory-Newton formulas from the 
error term in Newton's divided-difference formula 
8 Compute Ca) /(I 3) and (b) /(I 95) from the following data 


X J 

1.1 

1 2 

1 5 

1 

1 7 1 

1 8 

2 0 

fix) 

1 112 

1 219 

1 636 

2 054 

2 323 

3 on 


4 Compute (a) 2 and (b) from the following data 

X v'-r 

50 7 07107 

7 11143 

52 7 21110 

53 7 2H011 

54 * 7 .US47 

55 ! 7 41020 

50 i 7 48331 

6 Fii H ixilynominl of mmiiMum degree to the data of E\an)])le 1 
0 Fit a polvnc irn'il of ininiiriorn degn^e lo thc' following data 



f{i) ' n I 15 13 I 3i I (\7 


7 If i/n vi, iL, 1/3 aK‘ the valvH's of a fiinetioii at tlu* (‘qiialh spacer) a aloes j-„, n j rj, show 
flia! ()if' la>Ht ('stiina((’of the value of ?/(‘(»rreHponding to (hf'\nlu(Mif j niidwav betw^een j\ 
and I: IS 

V\ 4 - Vi {ih H- V’l) - (Vi) + 1/3'' 

2 16 

8 Three readings are taken at tajuallv spaced points x = 0, h, ‘Ih nraai the maximiini fniini- 
niuiTi) of a fiinetion \/ ^ f\x) Show' that tlu‘ abseissn of the inayiniuin ('minimum') is 
a]ipro\nnatelv 



and that thc maximum (mininuim) ordinate is approximately 

(^Vl + ri7/o)’ 

Vi ~ - 

8 A»7o 

9 Work I'AMniple S, given that the three points where readings are taken are not equally 
spai'ed 

10 Ijenv o Lagrange’s interjiolat ion formula bv expanding 

fU) 

U - Xo)U - r,) ix - Xn) 


into partial fractions 
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4.3 

Numerical integration and differentiation 

Any of the interpolation formulas we obtained in the last section 
can be used to find the derivative of a tabular function For 
instance, if we consider the forward GreKory-Ncwton formula 


/(X„ + rh)^U+r AU 4 -- >) A 4 “-2) 




1)^- 2 )( t _- 3_) 

4' 


A*/,, 4- 


( 1 ) 


( 2 ) 

(3) 

(4) 


(5) 

f6) 

(7) 

f8) 


(9) 


( 10 ) 

( 11 ) 

( 12 ) 


and differentiate witli respect to r, we find 

hf'Uv 4 rh) = A/„ 4 A'4„ t ~ ^ AYn 

Z h 

, -ir’ - Slr^ 4- Hr - 3 , 

+ AYo + 

/(Y"(ro 4 r/i) = AY„ 4 (r - 1) A’/a f ~ ^ ^ A% + 

lv'f"'(r« + rh) = AY„ + - A% + 
h>r'^(r„+ •■) = AYo 4 

Spccihcally, if we put r - 0, we find for the successive derivatives 
at the tabular jioint lo 

'(x„) = I ^A/„ - AY„ 4 r, AY„ - J A\f„ 4 ) 


f‘ 

/"(.r„) 


AY„ 4- [2 




) 


/''4r„) = i(AY„- ) 


Similarly, from the backward (iregory-Newton formula we 
obtain 

A/ I ^ a2/ 1 H- Or -f 2 

hj (xo H- rh) - A/. 1 H-Ay _2 + ' ~ 0 ^ 

2 r ^ 4 - 97-2 4 - 11^ _L 3 
4. 4. 

-h r/i) = Ay 2 + (r + 1) Ay,, 


^y^^^ro + r/i) = ^y _3 + 
^y^^Xio -h r/i) = Ay_4 4 


2r 4- 3 
2 


07-2 + 18 ;- + 11 

+- 12 — + 

AY_, + 
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and, at the f)oint xo, 


(13) 

/(«.) • i ( 

1 Ay. 2 + i Ay_, + ^ Ay_4 + 

(14) 

/"(») - 

^Ay_2 + A’/-3 + [-2AY.4+ ) 

(15) 

/ (i») - 

^Ay_, + ^Ay.4+ ) 

(16) 

/"(-.) - 

(AY 4 + ) 


For a riRorou.s development, an error term analogous to 
l'"q (8a), See 4 2, should he found for any formula of numeiieal 
differentiation 'This (‘im he done, hut th(‘ results are of lelatively 
little use in routine ealeulation^, and we shall not take them into 
aee.ouiit ]iow(‘ver. it, should h(‘ home in mind that, unless we are 
dealing with a polynomial, num(‘ri(al difTcnentiation may involve 
errors of eonsideiaf)le magnitude, the errors inen'asing signifi- 
eantly as derivativf‘s ol higli(‘r order aie eomjmted 


EXAMPLE 1 

Find tlu> nrflt and sprond dorivativrv of j- at j =2 T) froni tlic table 


s 

V ^ 


2 50 ! 

1 

1 

1 58114 

0 01573 

1 

2 55 

1 59687 

0 01558 

-0 00015 

2 00 

1 01245 

0 01543 

-0 00015 

2 65 

1 02788 

0 01529 

0 00014 

1 

2 70 

2 75 

1 64317 

0 01514 

1 65831 j 

-0 00015 


lJ8inR Eqs (5) and (0) with To " 2 50 and *= 0 05, wo find at oner 

/'(2.5) - 1^0 01573 - ^ (-0 00015) J - OillOO 

/"(2 5) - ^ (-0 00015) - - 0 0600 


The correct values to four decimal places are, of course, 

_ l__ 

2 y/i 


/'(2 5) 


- 0 3162 


/"(2.5) --- -0 0632 

4t V I *-2 5 

To obtain formulas for numerical integration, it is con¬ 
venient to begih by considering the related problem of the 
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summation of series, a topic on which we touched briefly at the 
end of Sec 4 1 In doing this it will be convenient to use certain 
additional operational eijuivalences which we shall nov develop 
We liegm with Maclaurin's expansion, 

(17) f(x + h) = fix) + hj'ir) + J"[x) + /'"(j) + 

or, introducing the operators E and D ^ d/dx, 

/ \ 

(18) EJ{)) = y] -f y/(-^) 

\ow, the senes on the light is simply the exjiansion of the 
(‘Xponential IIiMiee, we can write (18) m the foim 

I^:jU) - c''7(r) 

from which we inter the operational (equivalences 

{{[)) E - 

(1>0) A - E - \ = - 1 

Next, Ave introduce the int(‘gration operator 
//(r) = 

Tlioti 1 Dfii) = ^ /'(-r) '/i = J{x + h) — fix) = A/(.r) 

and, if E{x) is any antiderivative of /(j*), 

7>//(r) = T) /"^‘/(••) * = + h) - h'ix)] 

= fix + h) - fix) = A/(J) 

Hence, D and 1 commute with each other, and wc' liave the 
further ecqiiivalences 

(21) ID = 1)1 - A 

We are now m a position to establish the famous Euler- 
Maclaunn summation formula: 

i !• -1 •<' + -i +<■' * 1 (ih''•-'ft"'-" ~ 

where the 7?’h are the Bernoulli numbers lU = — 

to be defined below^ We begin by writing, with the aid of 
Kq (21), 

h Af{x) = hDIfix) 

or, replacing A by its equivalent from Eq (20), 
h(e^^ - l)f{x) = hi) I fix) 
or further, 

hfix) = I fix) 
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It IS now necessary to expand the fractional operator 
hD!— 1) in a ])ower senes in hD This can be done in various 
ways, but perhaps the simplest is to replace by its series 
equivalent and then make use of the method of undetermined 
coefhcients Thus we have 


hD 






4- 


= aJiD 


4 


or, sinq)hfyin|]; the fraction on the left and then clearing; 
fractions, 


-( 


/iD hHP h^IP 

^ 2’ V 4’ 


)( 


0(1 4 (iihD 4 




+ 


Now, multiplvmp; the two s(‘nes and etpiating the coefhcients of 
like [)(^)weis of hD on the two sides of this identity, we obtain the 
equations 


(h) -■= 1 


do 

V 


4 o, - 0 


do , di 02 

;p ' 21 4 


0 


-P _L 

4 ’ V 2 ’ 2 ’ 4 


0 


Oo , Oi 02 

,v 41 .P2» 


0 t 

2M» 


<h 


v 


from which we find without difficulty 
do =1 Oi - — 02 = •(, O', = 0 ni - — Mio, 

The function e^/(c'' — Ij occuis m numerous applications, 
and the coefhcients |rt,) in Us expansion have many interesting 
and important jirojicities These coefhcients aie ordinalily 
referred to as the Bernoulli numbers jB,}, and formulas have 
been develo})ed which give them explieitlv tor any value of i 
For our purjioses we luaal to know^ only tlie numerical values of 
the first few^ /f’s and the fact that after Bi all /?'s with odd sub¬ 
scripts are zero Thus we can write 



and hence, returning to Kq (23), 


or, detaching the first term from the series and factoring hD from 
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(24) 


(2r>) 


the remain mg terms, 

fix) 


Ifix) 




DIJM 


Now let us evaluat(‘ Eq (24) for x = to, ai, 
add tlic results, recalling that 


, Xn-i and 


A/o d Afi + 4" A/„_i — fn — fo 


/o 

_ 1 

h 

f^'fix)d.r + 

7x0 

1 ff 

1 = 1 

jA/o 

/l 

1 

k 

1"’fir) dr + 

V f-; ihoy-' 
^ 1 ’ 

-t = 1 

]a/, 

^ 1 

_ 1 

y fix) dr + 


'Ia/"' 


h 

jxn-i 

L 1 = 1 

J 

-1 

A 

/ 

0 

1 

" h 

1" fix) dr + 

Jxo 

1-1 

] if. - /o) 


Since B] ^ B 3 -- Br, — Bt ~ = 0, the last 

formula can be simplified somewhat by detaching the first term 
fiom tl)(‘ sum on the right-hand side and then setting z = 2^ m 
the rest of llie senes 


L 4 

t = 0 




Finally, if we add /,. to both members of this identity we obtain 
J'ormula (22), as recpiired 

If Eq (22) IS solved for the integral, we obtain 


r7(-r) dv = 

J-rn 





Jhi 




U _ .)) 


which is a fundamental formula of numerical integration Equa¬ 
tion (25) is especially adapted to the integration of functions 
defined by analytic exfiressions which can conveniently be differ¬ 
entiated For functions defined only by a table of values it is 
usually more convenient to have an integration formula in which 
the "correction terms" are expressed as differences rather than as 
derivatives To obtain such a formula from Eq. (25), we need 
only replace the derivatives /o, Jq", . by means of Eqs (5), 
(7), . and the derivatives /', f”', by means of Eqs. 
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(13), (15), 


. This gives us 


h‘^\\(.f , A*/. , AV„ , A*/.-. , \ 

T" + X- + ) 

-^-^^A/o- 2 - 


( 20 ) 


A Vo _ ^ , 
"^3 4 


720 


‘ \-(- 
!0 1 )r' \ 


AV.. 3 + ^AV„ , + 


) 


A * 2 


aYo H- 


+ 




V2 


+ /i + 


+ /n_l + 


(A _ ^ 

2 ; r. 


(A/n-l — A/o) 


- A , + 4./„) _ - AVo) 

3 / 1 . 


- ,» ■ + ^•f’> - 


)] 

)] 


Tvhifh IS known as Gregory’s formula of numerical integration. 

In passing, we note that both (25) and (2()) redu( (‘ to the well- 
known trapc'zoulal rule of integration if the eoin'ction terms aie 
negleeted, 

EXAMPLE 2 

C’oriiputr fix) di for llic function debned by the following tRblc 


X 

! f{i) 

A 


A" 


0 0 

0 4608220 

0 0144778 




0 2 

0 4842908 

0 0140108 

-0 0004670 

0 0000200 


0 4 

0 4083] (K) 

0 0135728 

-0 0004380 

0 0000266 

-0 (K)00024 

0 6 

0 5118834 

0 0131614 

-0 0004114 

0 0000243 

-0 0000023 

0 8 

0 5250448 

0 0127743 

-0 (M)03871 



1 0 

0 5378101 


j 




llHing Eq (26), we have at once 

^ . 1/0 4608220 0 5378101 

/ /(j) dx - 1 - - - -t- 0 4842008 + 0.4983106 -f 0 5118834 + 0 5250448 -f- - 

5 \ 2 2 

1 1 
- -- (0 0127743 - 0 0144778)-f-0(K)03871 - 0(H)04f)70) 

Af^ 1 Oo ■■ 


10 


- '-7- (0 0000243 - 0 0000290) - 
3,600 


0 5047073 
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The integral in this problem is actually log (2 95 H- 0 5x) dx, and its exact value is easily 

found to be 0,5047074, correct to seven decimal places The approximate value is, therefore, in 
error by only 0 0000 (K )1 


In many important appli<*ations it ia necessary to compute a 
running Integral of a tabular function, i e , an integral of the form 

(Jmdx 

jTa 

where j takes on successively each of the values at which f(x) is 
tabulated For such a calculation the familiar trapezoidal rule: 

(27) f(j') (is ^ h ^*2 + /i + /i F F A -2 F A-i F 

IS p.specially well adapted For il to tlu given table we adjoin a 
column of the averages 

/o F /i /i F /2 

2 ’ 2~ ’ 

the required integrals are piedsely the sums of the entries m tins 
(olumn from the toj) down to each entry in turn, multiplied by h 
Moreover, ich sum can be found fiom the preceding one by 
adding to it the next average Table 4 I shows the (;oinputational 
pattern in detail 

By lecording t‘aeh average in the cell above the one where it 
a])fa'ars in this tabh‘ and then summing the column of averages 
from tlie bottom njiward, the process can also be adapted to the 
calculation of running integrals of the form 


table 4.) 


X 

/(-f) 

Average 




‘2- 

f fi^-) dx 
Jxo 

Jn 

u 

— 

Io='’ 




f xo 

/ fix) dx 
Jxo 

X, 

/l 

/oj-/. 

2 

L-I 

^0 2 

“ 2 2 

‘L- 

f(^) 

11 

// 

f. 4 /, 

2 

L-I 


„ 4 f 4_-^“ 

2 ^ 2 ’ 

‘L- 

f^'fix) dx 
Jxo 

la 

/a 

h F U 

2 


‘ /a + /a 

-{■+;,+/.+J 

‘L- 

fix) dx 

i 
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Compute €* dx for I — 0 2, 0 4, 0 6, 


, 1 8, 2 0 from the following table. 


X 

e" 

Average 

I 

'*1 " /o"'**'* 

True value =■ e* — 1 

0 0 

1 000 


0 000 

0 000 

0 000 

0 2 

1 221 

1 no 

1 iin 

0 222 

0 221 

0 4 

1 492 

1 350 

2 400 

0 403 

0 492 

0 6 

1 822 

1 057 

4 123 

0 825 

0 822 

0 8 

2 22G 

2 024 

6 147 

1 220 

1 226 

1 0 

2 718 

2 472 

8 619 

1 724 

1 718 

1 2 

3 320 

3 019 

11 038 

2 328 

2 320 

1 4 

4 055 

3 687 

15 325 

3 005 

3 05 

I fi 

4 953 

4 504 

19 829 

3 960 

3 953 

1 8 

0 050 

5 501 

25 330 

5 006 

5 050 

2 0 

00 

e- 

0 719 

32 049 

0 410 

0 389 


Following the conifmtational Bchemo described above, with /i =» 0 2, we obtain tlie required 
integrals without diHiculty For purposes of coinpariaon, the theoreiicnl values of tlie integral, 
correct to thr<*(' decimal [daces are also Hhowii 11ml the inteival Ixdwei'n successive entries 
been smaller, say h —01, the accuracy would have been significantly higher, although for 
h “02 lie' last, and, therefore, the least accurate integral is in error hy only 


() 410 -_6 380 
’ 6 389 


X 100 


0 3% 


EXERCISES 

1 From the data in the following table compute the first three derivatives of In j at j * 200 
and at r “ 205, and check those against the exact values 


X 

In X 

200 

5 29831737 

201 

5 30330491 

202 

5 30826770 

203 

5 31320598 

204 

5 31811999 

205 

5 32300998 


2 Using the data of Exercise 1, compute the first three derivatives of In j; at j “ 200 5 and 
at r =« 204 5, and check these against the exact values 

3 Uh(‘ Eq (22) to obtain a formula for the sum of the cubes of the first n integers 

4 Using Eq (22), establish the relation 



I * a 


(Note that the equalitv sign is not used between the two members of the given relation In 
fact, although Bin at first decreases with n, it increases more rapidly than for any fixed 
a as n —» <x\ hence tlie senes on the right diverges and certainl\ cannot he said to equal 
the sum on the left Interestingly enough, however, the senes is a good approximation to 
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the sum if it is terminated at the point where its terms are a minimum. Divergent series 
with this property are usually referred to as asymptotic series.) 


6 


What IS 


1.000 



0 

7 

8 


Compute e"** dx for values of x at intervals of — 
/■i sin X 

Compute / - dx for values of x at intervals of * 

Jx X 

Compute sin x^ dx liy the trapezoidal rule with h 


0 1 from 0 to 1 
“01 from 0 to 1. 

— 0,3, and compare your answer 


with the results given by Eq (25) 

a when only the first-derivative correction terms are included, and 
b when the first- and third-derivative correction terms ore included 
9 Work Exercise 8 using Eq (26) and the corresponding difference correction terms 
10 Show that, when n = 2 and differences of order higher than the second are neglected> 
Eq (26) reduces to 



h 


-(/o + 4/, -f/,) 


By applying this to successive pairs of tabular intervals, establish Simpson’s rule: 

J(t) di - * (/o + if I ■(- 2/. + f 2/„-2 + 4/,., + /.) n even 

Jxo .3 

11 By making two applications of the formula of the last exercise, establish the following 
formula for the numerical evaluation of double integrals 

dx dy = [(/oo d- /o 2 4 An + Ad 

yi/D Jxo 9 

4 4(Ai 4 Ao 4 A? 4 Ai) 4" ifiAd 

where h and k are, respectively, the intervals at which x and y are tabulated, and “ 
/(xo 4 i/i,Vo 4 jA) Clive the generalization of this result to integrals of the form 

fVI^ [Tim 

I / fix,y) dx dy 

JVO JTO 

12 Establish the operational equivalence I) = 0/h) In (1 4 zi), and then, by expanding the 
right member into an infinite senes, establish Formulas (5) to (8) IHint Begin with Eq 
(20) I 

13 Establish the operational equivalence I) = {2/h) sinh ‘ 5/2, and use it to develop a central 
difference formula for numerical differentiation [Hint Begin with Eq (14), Sec 4 1, and 
Eq (10) I 

14 If Lagrange’s interpolation formula is integrated from Xv to x„, a formula of numerical 
integration of the form 

I'Xn 

I /(l) dx = Cofo 4 CiA 4 4 Cn-lfn-l “f Cnfn 

Jxn 

18 obtained Determine the values of the r’s when n “ 2, and thence derive Simpson’s rule 
(see Exercise 10) 
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Iff Obtaiu thp valuee of the c*8 in the formula of Exercise 14 
a When n 3 b When n = 4 


4.4 


The numerical solution of differential equations 

Ono of the most important applications of finite differenres is to 
the numerical solution of dififerential equations which, because of 
their complexity, cannot he solved by exact methods Many 
procedures are available for doing this,* some of considerable 
generality, others especially adapted to equations of a particular 
form Of the many methods which have been devised we shall 
]iresent only the method of Milne and the Runge-Kutla method 
These can be applied to simultaneous differential equations as 
well as to single equations of any order and are, therefore, ade¬ 
quate for almost any problem one is likely to encounter 

The fundamental problem is to find the solution of the first- 
order (iiffercntial equation 

( 1 ) - ib y) 

which satisfies the initial condition i/ = 7/n when x = j-o We do 
not, ('f course, • ;;pect to find an eijuation for the solution Instead, 
our object is merely to plot oi tabulate the solution curve point 
by jioint, beginning at (j*o,i/o) and continuing thereafter at 
selected values of i, usually equally spaced, until the solution has 
been extended over the required range 

To develop Milne’s method we begin with Eq (1), Sec 4 3, 
written in terms of y rather than/, and evaluate it for r = 1, 2, 3, 
and 4, getting 

?/! = ^At/o + i A’l/o - ^ A’yo 4- A’y„ + ^ 

Ut - ^At/o + 2 A^?/ii + g A’^o — j2 A\vn + ^ 

2/s = ^ ^Aj/o + “ A^'i/o + ^ A’yo + | A‘j/o -t ^ 

2/4 = ^ I T ) 

or, neglecting differences beyond the fourth and replacing the 
remaining difTereiices by their equivalent expressions in terms of 


• See, for instance, H Ivevy and E A Baggolt, “Numerical Studies in Differ¬ 
ential Equations,’' vol 1, C A Watts & Co , Ltd., London, 1934, and W E 
Milne, “Numerical Suiutionsof Differential Eiiuations," John Wiley & Sons, 
Inc , New York, 1953. 
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( 2 ) 


(3) 


(4) 


( 5 ) 


the successive functional values [Eqs (15a), Sec. 4 1], 

2/i “ (“3^/0 — lOt/i H- 18 j/2 — 6^8 H" 

y'l — ( ^0 — 8i/i H- 8^/3 — 2 / 4 ) 

2/3 “ (“ 2/0 + 61/1 — 181/2 ”1“ IO2/3 + 3^/4) 

274 = ( 3j/o - 16^1 + 361/2 — 48r/3 + 25.y4) 


Now, if we subtract the second equation m the last set from 
twice the sum of the first and third equations and solve the result 
for 7/4, we obtain 

4/1 

2/4 = 7/0 -h {2y\ — yj + 


or, in more general terms, 

4/1 

y»i4-i yn —3 "h ( 2 yn _2 yn —1 2y„) 


If we know the values of y and y' down to and including their 
values at Xn, Eq (3) thus enables us to “reach out’’ one step 
further and compute y„ 4 i With i/n-n known, we can then return 
to the given differential equation (1) and compute Then 
using Eq (3) again, we can find yr,+ 2 , and so on, step by step, 
until the solution has been extended over the desired range All 
that remains is to devise a means of finding enough y’s and y'’s to 
get the process under way 

One possibility is to begin the tabulation of y by expanding 
it in a Taylor senes around the point x = xo 

y - yo -f- yo(x — xo) -h yo —-h yo —-H ' 


The value of yo is, of course, given The value of yj can be found 
at once by substituting xo and yo into the given differential equa¬ 
tion (1) To find the second derivative we need only differentiate 
the given equation, getting 




Since /(x,y) is a given function, its partial denvatives are known 
and become definite numbers when xo and yo are substituted into 
them. Moreover, the value of y' at {xo,yo) has already been found, 
and thus (5) furnishes the value of y^. Similarly, differentiating 
(5) and evaluating the result at (xo,yo) will give y'^', and so on 
In this way the first few terms of the expansion of y around the 
point (xo,yo) can be constructed In especially favorable cases the 
general term of the series (4) can be found and the region of con- 
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(r)) 


vergenre established When this happens (4) is the required 
solution, and we need look no further In general, however, suc¬ 
cessive differentiation of f{x,y) becomes too complicated to con¬ 
tinue or the resulting senes converges too slowly to be of prac¬ 
tical value, and we must fall hack on Milne’s or some similar 
method 

With (4) available as a representation of y in the neighbor¬ 
hood of X = 3-0, we can set x = xq h ^ and calculate y\ 
Similarly, setting r = o-q + 2h and 2*0 -h 3/?, we can hnd and 
1 /a Then, substituting (ri,//i), Cr 2 ,.V 2 ), and (jsji/a) mto the given 
differential equation, we can compute t/J, 1 / 2 , and y[ without 
difficulty With these values we are then 111 a position to begin the 
step-by-step solution of the differential equation by means of 
Kq. (3) 

From the preceding discussion it is clear that Eq (3) is in 
general adequate for the step-by-step solution of ?/' = f(x,y). 
However, as a precaution against errors of various kinds, it is 
desirable to have a second, independent formula into which 
can be substituted as a check To obtain such an ccpiation we 
return to (2) and add 4 times the third equation to the sum of the 
second and fourth and solve the resulting equation for y^, getting 

1/4 Vi (.V 2 4 “k y'i) 

or, in more geiM^al terms, 

= 2/.1-I + ^ (y’n.l + + y'^+\) 

This formula cannot be used as a formula of extrapolation, since 
it involves which cannot be found unless yn^-i ns already 

known However, after has been found by means of (3), 
be calculated, and enough information is then available 
to permit the use of (6) If the value ot as given by (6), 

agrees with the value found from (3), we are ready to move on to 
the calculation of y^+i On the other hand, if the two values of 
yn^ \ do not agree, we must use the second value of ynM to com¬ 
pute a new value of substitute these mto (6), and continue 
the process until two successive values of y^j, 1 are in agreement 
When this happens, we are ready to continue the tabulation of y 
by returning to (3) and determining an initial estimate of i /„+2 
Formulas like (3), which express a new value exclusively in 
terms of quantities already found, are known as open formulas or 
predictor formulas. Those, like (G), which express a new value m 
terms of one or more additional new quantities and which, there¬ 
fore, can be used only for purposes of checking and refining are 
known as closed formulas or corrector formulas. 

The method of Milne is readily extended to the solution of 
simultaneous and higher-order equations. For instance, if we have 



SEC 4 4 


THE NUMERICAL SOLUTION OF DIFFERENTIAL EQUATIONS 


111 


( 7 ) 


the two ^uations 

2/' = and z' = g(x,y,z) 

With the initial rorvditions y — yo, z = Zo when x = Xo, and if by 
independent means Ve have ealrulated {yuyi,y^), (21,22,23), and 
the related quantitiesXfi/J,!/^,!/^) and {zi,z[,z[), then, using Eq (8) 
and an identical version with z replacing y, we can compute 
7/4 and 24 After that, \we can compute y\ and 24 from the differ¬ 
ential equations and agabi use (8) to obtain 7/5 and 25, and so on as 
far as desired. Of courseL the closed formula (6) can be used to 
check and correct both and Zn^\ if and when this is deemed 
necessary 

The application of Milne’s method to equations of higher 
order is now immediate, sViice such an ecjuation can always be 
replaced by a system of siimiltaneous first-order equations For 
instance 7/" = g(x^y,y') is cqu^alent to the system 

y' = 2 z' = g(x,y,z) 


which IS just a special case, with f^y,z) ^ z, of the general 
firoblcm of two simultaneous first-order ^nations 

The Runge-Kutta method differs frorfc Milne's method in 
several signi 'ant respects Tn the first placa it requires no pre¬ 
determination of a set of starting values and, hence, is com¬ 
pletely self-contained Second, it docs not require the values of x 
at which the solution is being tabulated to fte equally spaced; 
hence, the interval between successive values of x can be varied 
throughout the process, as time and accuracy may require 

The Runge-Kutta method tan be thought of as a generaliza¬ 
tion of the following extremely simple (and qu^^e inaccurate) 
procedure If one is given the first-order differenti^equation 


(ip 

dx 




and the initial condition y — ?/o when x = Zo, the value ofV/, say 
2/1 = 2/0 -f j*i = xo H- Ax can be ajiproximated by ysing 

the usual differential^estimate of the increment A?/, 

Ay = ^\ Ax =- f(xo,y^Ar 

(12 Uo,j/o 

With this value for Ay avafk^ble, an approximate value for 
2/1 = //o H- A?/, namely, 

.Vi = //o -b ! Aj- = yo -b fi^o,yo) Ax 

(IX \xa.yo 

IS determined, and the process can be repeats to obtain 2/2, 
yit 

On the other hand, having a first approximation"\p yi, one 
can compute dy/dx at the point (xi,yi) and then use the iLyerage 
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( 9 ) 


value 


\(^y\ + ^ I ^ 

2 \dx lxo,i/o dx \xi,v< j 


instead of 


dx xo.I/o 


in Eq. ( 7 ), to obtain a (presumably) more accurate value for i/i, 
namely, 


7/1 


= J/o + 2 


2 \dx |x*.Vo dx Ixi.yi J 


-I- /(Jo,Vo) +f(-ri,P i) 


before attempting to find 1/2 Or one can compute the value of 
dy/dx at the point 


(lo + Y- 


and use this instead of the derivative at (jo, 7 /o) m F]q. ( 7 ) to 
obtain an improved value of yi, namely, 


■ 

!/i = .V" + 






before continuing The procedure based on Eq ( 7 ) is known as 
Euler’s method; that based on Eq ( 8 ) is known as the modified 
Euler method; and that based on Eq ( 9 ) is known as Runge’s 
method. 

In the Runge-Kutta method, three or more estimates of ^y 
are computed, and then the value of Ay which is finally used to 
determine i/i is taken to be a linear combination of all of these 
Specifically, in Kutta’s third-order approximation we let 


Aiy ^ ki = f(xoyyo) Ax = f(xo,yo)h 

A2y = fca = f(xo + p Ax,yo + p Aiy) Ax = f{xo -f- ph,yo + pki)h 
Aay E /f, = f(xo -f q Ax,2/0 -h r A2I/ q - r Aiy) Ax 

= /(xo -f- qh,y^ + rA:2 -h g - rfci)A 

and then put 

Ay ~ aki -h bk2 ck^ 


Jo 


where a, 6 , c, p, q, r are constants to be determined to ensure the 
highest possible accuracy in Ay. 

To do this, we must first expand ki, fc^, k^, and then Ay in 
terms of powers of Ax s h, using implicit differentiation to 
compute the necessary derivatives Using subsenpts to indicate 
the partial derivatives of / evaluated at /i = 0 , i e , letting 




d/( x,2/) ^ df(x,y) ^ dy(x,?/) I _ 

dx xo.y/ * dy xo.yo dx^ \XQ,Vo 


and using dkjdh and d^kjdh^ as abbreviations for 
and d*A:,/d/i* 1 ^^^, we thus have 
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fci = M 




/..p’ + 2/.,p* ^ + /„p= 

— foh -{- (/i -h f2fo)ph^ + ifn + 2/12/0 + /22/o^) -^ 


»,VU' + 


t, 


= ^/o + |/ig + /2 

j/ii?’' + 2 /i 2 g j^r 


dki , . . rfA' 

+ \fnq^ + 2fng | 


^] 1 ‘ 

[' 


+ M ^ rfP + (? - ^) 


,/iV 


)» 


— /o^ + (/i -f/ 2 /n) 7 /i^ -f [(/n -h 2 / 12/0 +/ 22 /o^) 7 " + ^fi{f\ "f/i?/o )1 .5 “ 1 “ ' 


Hence, substituting, 

Ay = aki + bki + ckz 

~ afoh 4 - b j^/o/? 4 " (/i -i- f2/0)ph"^ 4- ifu 4 - 2/12/0 + ^22/0^) ^"2 —^ j 

+ c |m + (fi+f )qh- + 1^(/i, + 2/.4/-„ + h.J^'‘)q'‘ 

+ 2 / 2(71 + /2/o)p/'j ^ + I 

(10) = (a 4' b 4“ c)/o/i 4- (bp 4- cq)(fi f 2 f(})h^ 

+ (/,. + 2/12/0 + + rprMf, + /2/0) j /i’ + 

Now, since y' — /(x,v), wc have, by Maclaunn’s expansion, 
Ap = p - Po = lAh + p'' I’ H p"' + 

(11) = /o^ + (/l + /"/(l) ^ + [(/ll + 2/12/0 +/2l/o*) + ftifl + (?/o)] ,J-, + 


Hence, Ay as giveui by ( 10 ) will agree with the IMaclaunn expan¬ 
sion of Ay, as given by ( 11 ), through terms in /i* = (Ar)®, provided 

ri 4- 4- c - 1 bp cq = ^ 

bp"^ -h Cf/ 1 1 

=0 ‘=^’• = 6 


We thus have four equations in the six unknown parameters 
P, Q, ^ The first three equations are linear in a, 6 , c and can 
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easily be solved to express a, 6 , and c m terms of p and q Then the 
fourth equation can be used to express r in terms of p and ^ also 

_ 6pg — 3 (p -f g) 4- 2 , _ 2 — 3 g 

® “ 6p9 6p(p - q) 

. = J - P) 

f>q(q - P) P (2 - 3 p) 

Since p and 9 are arbitrary, we thus have a two-parameter family 
of formulas which can be used for the step-by-step solution of the 
equation y' = f(x,y) with an error which is of the order of 
(Ax)* = 

The following particular cases are worthy of note. 

(I) a = H h = 0 c = ^4 p = 9 = r = 23 

= >4(^1 “b d/ca) 
where ki = fixoyyo)h 

ki = /(xo + yo “h 

^8 = d" 2/0 + / 3 ^ 2 )k 

(II) a = 6 = c = p ^ q =■- r -= % 

H" ^^2 d" ^3/ca) 
where /ci = f{xo,yQ)h 

k^ = /(xo -{“ 2.3/1, 2/0 "b 
kz = /(xo + %/i, 2/0 + %k2)h 

The values of the parameters in case (II) cannot be obtained 
from Eqs (13), since p = q, but can he checked directly iii Eqs 
(12)^^ 

The foregoing analysis can be extended without difficulty to 
yield step-by-step solution procedures in which the error is of the 
order of (Ax)'* = In particular, the following two sets of 
formulas are quite useful 

(III) A2/ == 36(Ai -b 2^2 + 2A-, -h k^) 

where ki = f{xo,yo)h 

^2 — /(X() -b \' 2 ^, yo "b t''2/f])/i 
ki ~ /(xo “b }2^f 2/0 “b \'ik'i)h 
^4 = /(xo 4 - /i, 2/0 "b kji)h 

(IV) Ay — }^{k] -f- .Sfcj + Ski -h ki) 

where ki = /(xo.2/o)/i 

A'2 = /(xo 4 - }^h, 2/0 -b ba/fi)/^ 

A'a = /(xo 4 - 2/0 4 " A2 — * ik\)h 

ki — /(xo 4 - /i, 2/0 d“ “ A2 -j- Ai)/i 

The solution process based on (III) is often referred to specifically 

as the Runge-Kutta method. 
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Any of the Runge-Kutta formulas can be used to solve 
simultaneous and, hence, higher-order differential equations. For 
instance, using (III), we can tabulate the solution of the system 
of equations 

Tx = I = 

at intervals of Aj- = ^ by computing 
Aiy = ki = f(xo,ya,Zo)h 
Aiz = h = g(xo^yQ,Zo)h 
A2I/ = /C2 = /(-To “h !/o *i“ 

A22 = I2 = g{xQ + y2h, 2/0 + 2 o -h Hli)h 

Aa?/ = A'a = /(j'o + 2/0 ~h ^2^2, 2 o "b ]^h)h 

Aa2 = U = g{xo -b 2/0 + ^2^2, 2o y2^i)h 

A42/ = /r 4 = /(xo + 2/0 -b A; 3 , 2 o + /s)^ 

A42 ^ U ^ gixQ h, I/O /fa, 2 o + /a)/^ 

and then using the formulas 

A// = y^i^y + 2^2 + Sfcs + ki) 

Az = K(^i r 2/2 + 2^3 -b 14 ) 

If the various increments are computed in the indicated order, 
each involves only quantities which have previously been 
calculated 

EXAMPLE 1 

Tabulate the Holution of y' = x* -f // at intervals of /i = 0 1 if 1 / = — 1 when j = 0 
T'hhik the riuriKo-Kutta formulas (III) for the first increment, we have 

ki = -0 1000 k2 ™ -0 1048 k, = -0 1050 In = -0 1095 

and = -0 1048 

Hence, iy, - -|- At/ = -I 1048 

For the second increment, we have, similarly, 

k, - -0 1095 fc, - -0 1137 k, = -0 1139 fc* - -0 1179 

and Ay - -0 1138 

Hence, Ay = -1 2186 

For the third increment, we have 

k, -0 1179 kn - -0 1215 it, » -0 1217 k, - -0 1250 

and Ay - -0 1216 

Hence. y, « t/j 4- Ay » -1 3402 

This process can, of course, be continued as far as desired However, we shall calculate just 
one more value of y, this time usiriK Milne’s method, which can now be applied since we have 
values for yo, yi, yi, and yi To do this we must first compute y^, y[, yj, yi from the differential 
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equation, getting 

- _1 000 y\ -1 0948 - ~1 1786 yi » -1 2502 

With these values, we can now use the open formula, Eq (3), to obtain 
7/4 - -1 4082 

Using this value, we find from the differential equation that 
7 /; - -1 3082 

With this we can use Eq (3) again to find yr,, or we can first use the closed formula, Eq (0), to 
check y 4 before continuing In this case Eq ( 6 ) also gives us 1/4 = — 1 4682, which is a good check 
on the accuracy of our calculations 

The differential equation y' = + y is so simple that it can be solved exactly without 

recourse to numerical methods, and by the methods of Chap 1 (or Chap 2 ) we find at once 
that the required solution is 

y ” c' — I* — 2 j — 2 

For j « 1 , 2 , 3, 4 this gives us the correct values 

y, -1 1048 7/2 = -1 2186 1/3 = 1 3401 7/4 = -1 b»82 

The values we comjiuted for 7 / 1 , f/ 2 , and 7/4 agree with these to four flecimal 7 >lafes, find tlic value 
wo coirqiubed for i/a dilTers fioin the correct \alue by only 1 m the fourth place 


EXERCISES 

1 Using the Riinge-Kutta method (III), find i/a and ?/» in Exam])Ie 1 without finding i/r., 1/7 
or ya Mow do tliese values (omparo with the eorrect values? 

2 Using Kutta’fl third-order approximation (I), tabulate the solution of the equation 
y' ^ X — y at intervals of «= 0 1 if ;/ * 1 when x “ 1 

3 Using Kiitta's tliird-oidor ajqiroxirnation (II), tabulate the solution of the* equation 
y' = T -h )/ at intervals of /i = 0 1 if y = 1 when j = 0 

4 Using Milne’s method, tabulate the solution of the equation ?/' = j T y at mter\als of 
A = 0 1 if y 1 wlien x = 0 

6 Using the llunge-Kutta metliod (III), find 7/1 and Zi for the solution of tlie system 


dy 

dx 


X -h z 


dz 

dx 


- y 


given fi ™ 0 1 , and 7/ = 0 , z = I when j- =« 0 

6 Using Milne's method, tabulate the solution of the system 

dy dz 

- =“ 7/’ + J-z = yz 

dx dx 

at intervals of fi * 0 1 , given Vu - 0 , Zo = 1 

7 Work Exercise 2 using the ojien forniulii 

7/nn = J/n -h h(yl -b ^y'^ , T -2 ^’’^4 3 + '’7 20 ^ 4 ) 

and the closed formula 

VnU “ //n + ~ ^2 " ‘l2 " ^24 y'n 2 ~ ^ ^'7‘2 0 Ah/'..,) 

(These ecjuations consjitute the so-called Adams-Bashforth method for the mimoricul 
solution of ditlerentiul eriuHtious ) 

8 ExjiVun how tlie Adtims-Bnshfoi th method described in Ex(‘rci 8 e 7 ran be extended to 
8 yatA'>Mtns of diflerential equations and equations of higher order 

9 Elimmate the difTerenees from the formulas of Exercise 7, and express y„+i directly in 
terms of y„ and the vaiious values of y' 
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10 Work Exercise 3 using the open formula 

Vn + l = Vh + h{^H2Vn - + H2^/1-*) 

and the closed formula 

Vn + l “ Vn 4- + ^2Vn ~ 

(These equations constitute the so-called Adams-Moulton method for the numerical solu¬ 
tion of differential equations ) 

11 Using the open formula 

1/nn = 27/„ - j/„_, f h'^iy^ 4 H 2 ^^Vn-%) 
and the closed formula 

= 2vn “ Vn-y 4 h^{yn 4 M 2 

tabulate the solution of the equation v" "= rr -|- at mlervnls of Ax — =“ 0 I, given 

2/0 = 1 , ?/o = 0 How do vour results compare with the exact solution? 

12 S('t up the Kutta third-order approximation corresponding to the values p =* 3^, *7 = 

and show that it reduces to Simpson’s rule W'hen f(j,y) is independent of y 

13 By expanding each term in Eq ( 3 ) around the point x =■ x„ a, show that the principal 

part of the error m Milne’s open formula is j Wliat is the principal part of the 

error in Milne’s closed formula^ 

14 Find the equation of the polynomial of minimum degree for which y and y' take on pre- 

Bciihed valui'H (vn,?/i) and (y},y[) at x = 0 and i h What is the value of yi given liy this 

polynomial? How might Uiis result be used to carrv out the step-by-step integration of a 
difTerential equation of thi form y' «= fiJ,y)'f How might an accompanying closed formula 
be obtained? 

16 Find tlie equation of the polynomial of minimum degree for which y and y'' take on pre- 
scrilied values (vo,'/i') and (i/nvl ) at x = 0 and x = A What is the value of yz given by this 
po'^nornial’'’ How might this result be used to carry out the step-by-step integration of a 
differential equation of the form y" =«= /(xp/)? How might an accompanying closed formula 
be obtained? 


4.5 

Difference equations 

The many similarities we have already observed between the 
caleulus of finite differences and the ordinary, or infinitesimal, 
calcuhis suggest that there should be a theory of difference equa¬ 
tions roughly tiarallcling the theory of differential equations, and 
this IS indeed the ease However, in the study of difference equa¬ 
tions we do not ordinarily consider equations of the form 

(1) m)y = 4>ix) 

as might be expected by analogy with the differential equation 

(2) f(D)y = 4’{x) 
but rather equations of the form 
my = 4>ix) 


( 3 ) 
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This, of course, is simply a matter of notational convenience, 
since, using the operational equivalence A = E — 1 , any function 
of A can be transformed at once into a function of E, and vice 
versa In this section we shall restrict ourselves to the case of a 
single linear, constant-coefficient difference equation 

(4) {a^E^ -f- aiE^-^ + • • -f- ar-iE -j- ar)y = 

where 4>(x) is a linear combination of terms or products of terms 
from the set 

k* cos kx sin kx k & constant 
and j" n a nonnegative integer 

Since the substitution ( = hx will transform a function of t 
tabulated at intervals of h into a function of x tabulated at unit 
intervals, it is clearly no restriction to assume ^ = 1, so that 
invariably Ef(x) = fix 1), and we shall do this throughout the 
present section We shall base our solution of Eq (4) primarily 
on analogv with linear, constant-coefficient differential equations, 
and such theoretical results as we may need we shall merely 
quote without proof 

In Eq (4), if both Oo and Or are different, from zero, as we 
shall henceforth suppose, the positive integer r is called the order 
of the equation. If <f>(x) is identically zero, Eq (4) is said to be 
homogeneous; if <p(x) is not identically zero, Eq (4) is said to be 
nonhomogeneous. By a solution of (4) we mean a function of x 
with the property that, wh<*n it is substituted into (4), it reduces 
the equation to an identity I'rom a theoretical point of view both 
X and y should be regarded as continuous variables related by 
Eq (4) on a set of equally spaced values of .r However, in prac¬ 
tical problems wc are almost always interested in y only for the 
discrete values x = , — d, — 2, — 1. 0, 1, 2, .t, , and in 

our work we shall attem})t no more than the determination of 
solutions defined on this range 

Eor the second-order linear difference eijuation, with either 
variable or constant coefficients, w^e ha\e three theorems com¬ 
pletely analogous to the fundamental theorems of Sec 2 1 


THEOREM 1 

If yi(x) and y2{x) are any tw^o solutions of the homogeneous equation 
{aoE"^ -f- aiE + Oj)?/ = 0 

then riyi(x) ('2y2(x), where Ci and C2 are arbitrary constants, is also a solution 

THEOREM 2 

If J/iW iwiid y2(x) are two solutions of the homogeneous equation 
(floE* aiE d- a2)y = 0 
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for which 


C[yi(xl 2/,(:r)]t 


Eyi(x) 


y2(x) 

Ey2ix) 


0 


then any solution yi(x) of the homogeneous equation can be written in the form 
ysix) = ciyi(x) 4- c^y^ix), where ci and are suitable constants. 


As a consequence of Theorem 2, the expression C\yi{x) -h 
IS called a complete solution of the homogeneous equation when 
the particular solutions yi{x) and y^ix) satisfy the condition 

C\yi{x), y 2 {x)] 9^ 0 


THEOREM 3 

If Y{x) IS any solution of the nonhomogeneous equation 
+ aiE + a2)y = <t>ix) 

and if Ciy\(x) -|- C 2 ?/ 2 (j") is a coinjiletc solution of th(‘ homogeneous equation 
obtained from this by deleting the term <i>(x), then 

y = riijiix) 4- C 2 y 2 (x) 4- Tfr) 

is a complete solution of the nonhomogeneous equation 


As 111 the theory of diffeiential efjiiatioiis, any complete solution 
of the related homogeneous e(|ua(]on is usually called a com¬ 
plementary function of the nonhoniogeneous eciualion The 
extension of these theoiems to diffeience equations of order 
greater than 2 is obvious 

To find jiarticulai solutions of the homogeneous equation 

(5) {o,qE^ aiE + a?)// = 0 

when the coefficients ao, o? are constants, we might try, as 
with the analogous differential equation, 

(6) y = 

However, it is more convenient to assume 

(7) y = 

which 18 clearly equivalent to (6) with M = c"* Substituting this 
into recalling our agreement that Ej{x) = f{x 4-1), we 
obtain 

-h a2^/"' = 0 
or, dividing out M^, 

(8) aoAf® H" a\M + a2 = 0 


t The function r[^i(x), Vifj-)) is customarily referred to as Caaorati’s deter¬ 
minant. after the Italian mathematician Fehca Casorati (183&-189()) Its 
resemblance to the Wronskian W[yi{x), y%{x)] (see Sec 2,1) is apparent 
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Naturally enough, this is called the characteristic equation of the 
difference equation (5). 

If the roots M\ and Mi of (8) are distinct, then 
C(Mi‘,M 2 *) = - M{) 9^ Of 

and, hence, by Theorem 2 , a complete solution of Eq ( 5 ) is 

( 9 ) y = cyM\^ + ciMi’^ 

If M\ and Mi are real, this is a completely acceptable form of the 
solution However, if M\ and Mi are complex, then (9) is incon¬ 
venient for most purposes, and it is desirable that wc reduce it to 
a more useful form To do this, let the roots be 

My, Ml = p ± iq = 

where r = 

Then we can write 

y = Ci{re'^Y + Ci{re~'^Y 
= r*(cic‘*' -h 
= r®[ci(coH dx -f i sin dx 
= r*f(ci -h Cl) cos Bi + i{ci — sin Bx] 
or, renaming the constants, 

(10) y - r*{A cos Bx -|- B sin Bx) 

If My = Ml, clearly C{My',Mi*) = 0, and wc must find a 
second, independent solution before we can construct the com¬ 
plete solution of (5) Again by analogy with differential equations, 
we are led to try 

y = xMy^ 

and we find by direct substitution that this is indeed a solution 
when the characteristic equation (8) has equal roots For we have 

ao(x -f 2)My^'^ + ay{x + + aixMy- 

= xMy^iCL^My^ dyMy + fla) “j- A/^(2aoAf i H" CLy) = 0 

Since the coefficient of xMy^ vanishes, because in any case My 
satisfies the characteristic equation (8), and the coefficient of 
My^^ vanishes, because when the characteristic equation has 
equal roots their common value is My = — ai/2ao Moreover, for 
the solutions Mi* and xMy* we have 

C{My%xMy^) = My*{x -j- - xMy^My^^^ = 5^ 0 

Hence, according to Theorem 2 , a complete solution when the 


and tan B — 


qX 


] + C 2 (cos Bx — I sin 0 j:)] 


t Since aj 0 , or dec the difference equation would be of order leas than 2 , 
contrary to hypothfesis, it is clear that neither My nor Mi can be zero, 
t For a discussion of the exponential form of a complex number, see Sec 14 7 
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( 11 ) 


characteristic equation has equal roots is 
y — ciMi* -1- ctxMi^ 

The results of the preceding discussion are summarized m Table 
4.2 

labia 4 ? 


Difference equation {a^E^ -f- a\E -h ^ 2 ) 1 / = 0 ao, a-i ^ 0 
Characteristic equation aoAf® + fliA/ -f- 02 0 


Nature of the 
roots of the 
characteristic 
equation 

Condition on the 
eoefficients of the 
charaitensile equation 

Complete solution of the 
difference equation 

Real and unequal 

Af 1 5 ^ M 2 

aP — 4(1002 > 0 

y ciMi' + CiM2^ 

Heal and equal 

Af, = M 2 

Ui* - 4aoa2 — 0 

y == cjMi* + C2xM 1 * 

('onjugate complex 

ai® — 4aoa2 < 0 

y ■=• r^(A cos dx B sin dx) 

Ml = p 4- i</ 


r = "n/p* -f 7* 

M 2 = p IQ 


tan d »» q/p 


EXAMPLE 1 

F^ind a complete solution of the difference equation {E'^ -|- 2E A)y — {) 

The characteristic, eciuatioii in this case is Af* H 2M T 4 =“ 0, and its roots arc A/,, 
^2 = — 1 ± 1 Since 


r = V(-,) * + (\/ 3)* = 2 and 

we have as a complete solution 

/ 27rx 2irx\ 

y = 2* ( i4 cos —h B sin j 


e “ tan 


, V3 


-1 


27r 

3 


To solve the non homogeneous equation 


(12) (ao^^ -h (iiE -h fi-ijy = 


we must, areording to Theorem 3, add a particular solution of 
(12) to a complete solution of the related homogeneous equa¬ 
tion (5), To find the necessary particular solution 1", we use the 
method of undetermined coefficients, starting with an arbitrary 
linear combination of all the independent terms which arise from 
(t>(x) by repeatedly applying the operator E As 111 the case of 
differential equations, if any term in the initial choice for }" 
duplicates a term in the complementary function, it and all 
associated terms must be multiplied by x until duplication is 
eliminated. The procedure is summarized in Table 4 3 
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table 4.3 


DifTerence equation + aiE + ai)y — 


«p(x)* 

Necessary choice for particular solution Y t 

1 a (constant) 

A 

2 ox* 

(A: a positive 
integer) 

+ + At-,x + At 

3. ofc* 

Ak‘ 

4 a COB kx 

A cos kx A~ B sin kx 

5 a sm kx 

6 ax*/' cos mx 

(Aqx* A~ ~i" A*:_ix -f Ak)B cos mx 

+ (Box* A- -h Bk-ix -f Bk)I^ sin mx 

7 ax*/' Bin mx 


* When (t>(x) ronaiHts of a sum of several terms, the appropriate choice for V 
IS (lie sum ot the V expressions corresponclinR to thesc^ terms individually 
t Whenever e term in any of the Y’h listed in this column duplicates a term 
alrend> in the complementary function, all terms in that Y' must be multi¬ 
plied by the lowest positive integral power of x sufficient to eliminate the 
duplication 


EXAMPLE 2 

Find a complete solution of the difTerence equation (£* — 5£' + 6 )?/ = j -|- 2 * 

The characteristic equation in this case is Jl/* — + h = 0, and from its roots A/i “ 2, 

A/j “ ,‘l, we can immcdiatelv construct the complementary function y ~ ri 2 * + Co.':!' For a 
particular solution we w^ould ordinarily try Y >*= Ax ^ Ft -Y f’2® However, it is clear that C2* 
duplicates a term in the complementary function Hence, we must multiply f72* by x before 
incorporating it in our i hoice for >' Thus we substitute Y = Ax -Y H A- Cx2^ into the difference 
equation, getting 

{A{x + 2) + + C{x + 2)2*+*J - 5lA(x + 1) + /? + r{x + l)2''^i] 

+ d\Ai -A B A- Cx2’] = i -b 2 » 

or 2Ax A~ (-3^ A- 2B) - 2C2- - x -f 2 * 


which will be an identity if and only if A — ^ 2 . B = and f’ 
therefore, 


y 


Ci2- -f- r,3* 


2x -f 3 


x2* 


— A complete solution is, 


EXAMPLE 3 

Find the sum of the senes 

n 

« - 2 xk* k I 

T-1 

Clearly satisfies the first-order difference equation 
a.4i - Sn (E - i)8„ ~ in A- !)*-+» 
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Thp chararteristic equation here is 71/ — 1 = 0, and so the complementary function is simply 
^ = c, To find a partnular intcRral, we assume 

iS = (an -f- 

Then, substitiitinR, wt must have 

4 1) -I - (an d = (n 4 1)A"+' 

or, dividing out ^ and collecting terms, 

n(ak — o) 4 (ak -f hk - />) ^ ri 4 1 


This will he an identity in the variable n if and only if 



a(A - 

- 1) = 1 and 

ak -1 

b{k — I ) = 1 

or 

a = 

1 

and 

b = 

1 


k 

- 1 


(/' - 1)2 



n ] 



Hence, 

s = 

- — 

A«ci 



k - 1 (A - 1)2 




and a complete solution is 

„ n(A- - 1) - 1, 

s = r, 4 7? = r, 4 - - 

(k - 1)» 

To determine Ci w^e use tin obvious fact that when t? = 1, .s = A' Thus we must have 
k - 2 k 


Ifeiicc, finallj', 


k 4 lti(A - 1) - 
~ (k - \)^ 


(k - 1)^ 


EXAMPLE 4 

in the ^Nstern shown in Fig 4 2(i the point I*n i*' ke[)f at the constant potential 14 with respect 
It) the ground W'hat is the potential at eaeh of the points 74, , /4 i? 

Accoidmg to KirchholT’s first law , the sum of the (urreiits flowing toward an> junction in a 
rn twork must cijual the bum ot the cumuitb flowing aw a> Iroiii that junction Hene(‘, at a general 
jioint f, (Fig 4 2b) we have 

'ix ~ ix+\ 4 / 

or, replacing each current by its equivalent according to Ohm's law, 

^ ^ ~ 14+2 bi+i 

r “ r * ~2t~ 

or, finally, 

0 1 j + 2 — ^2^ r+l 4 1 X = d 

rills equation holds for j* = 2, , n — 2, that is, at all but the points P^ and 74_i, where 

w’c have the respective conditions 


U-lj 

( 15 ) 


“ 1 2 F 5^2 bi = 1 ( 

~^'2l n-l 4 Fn-.z “ 0 


Since Vo iR given 
since Vn “ d 
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Equatmnfl (13), (14), and (15) constitute a system of n — 1 linear equations from which 
the unknown potentials Vi, Vj, , F«_i can be found by completely elementary though very 
tedious steps for any particular value of n However, it is much simpler and more elegant to 
regard Eq (13) as a second-order difTerence equation, subject to the end conditions (14) and 
(15), w'hich will serve to determine the values of the arbitrary constants appearing in any com¬ 
plete solution of (13) 

Taking this point of view, we first set up the characteristic equation of Eq (13) 

- ^iM -f 1 - 0 

From its roots Af i = and Af 2 = 2, we then construct a complete solution of Eq (13), namely, 

V. “ A my + H2- 




FIGURE 4 2 

A ladder-tv pe network with identical loops (Although the network shown in Fig 4 2a 
appears to contjam exactlv seven loops, the number of loops is actiinlly indefinite This is im¬ 
plied by the fact that the central portion of the figure is drawn with lighter lines, this conven¬ 
tion will be used throughout the book to suggest a configuration of indefinite extent ) 
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EXERCISES 

1 Find a complete solution of each of the following equations 

a {FJ + 7£' + \2)y - 0 b (^* 4* 6 /? -f- 9)?/ = 0 

c -h 2£ + 2)y = 0 d (A» - 3A + 2)i/ = 0 

2 Find a complete solution of each of the following equations 

a {E^ ~ E — &)y = j-* b (4E^ — 4E -h l)v “ j- -I- 2 -f 2* 

c (E^ + 4 )1/ = cos j d (A* + 6A + 18)1/ = 2^' 

e (E^ - ZE 4 2 )v - 2 - -h 2 "- f - 4/? -h 4)y - 2 * 

8 Find a complffo solution of each of the following equations 

a {E^ — E — {S)y = j -\ M b (A’* + 1 )?/ == sin j 

4 Find a complete solution of each of the following equations 

a + 11 /^ - 6 ) 1 / = 0 b {K^ - 16)(y « x + 3" 

c (A’* + loA* + 9 ) 1 / - 0 d (E* + SE^ - 0 ) 1 / = 5 


6 Show that the diffen'oce e(|uation (A* -- 2\E + 1)?/ =■ 0 has the indiealed solution in each 
of the following special ( asc's 


X < -1 
X = -1 
-1 < X < 1 
X = 1 
1 < X 


y — A( — \)' cosh /IX + A( —1)' smh /ij cosh /* — — X 
y = A{-\y -f /ix( -i)- 

y = A cos ^^x E sin /xx cos /x =» X 

y =‘ A Hj 

y = A cosh yj 4- E sirih yx (’osh /x = X 


6 Work Exairipl(‘ 4 wnth both Pq and Pn maintained at the constant potential I’n 

7 Work F^xample 4 given that the eoniinon value of the resistances in tlie vertical blanches 
is Jrr 

8 A system consi-sts of n hpnng-connected masses, as shown in Fig 4 .-I What is tlie disjilace- 
ment of each mass from its original position wh(*n tliC system is again in eiiuilibnuin after 
a force Fq is ajiplied to the right-hand end'!' 



FIGURE 4.3 

(See explanation of convention used for Fig 4 2 ) 


9 Show that the nth-order determinant 




X 1 0 
1 X 1 
0 1 X 

0 0 0 
0 0 0 


0 0 
0 0 
0 0 

X 1 
1 X 
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satisfies the difference equation (i?* — \E -|- l)Z) ™ 0 Hence show that, when X > 2, 

sinh (n + 1 )m X 

Dn “ -- where cosh /i — — 

smh n 2 

What iB Z)„ if X = 2? -2 < X < 2? X = -2? X < -2? 

10 If ^ 1 ( 2 :) and y^i^) are any two solutions of the general linear second-order difference equation 
(ao(x)i.’* + a\{x)E + a-i{x)\ii = 0, show that Caaorati’s determinant r[7/j(j), 7 / 2 ( 2 ')] salisfies 
the relation |ao(j)/? a.(x)ir = 0 [Hint Write down the conditions that both y\{j) and 
y^{x) satisfy the given equation, then eliminate the terms in Ey^(I) and Eyi{i) 1 

11 Prove Theorem 1 

12 Prove Theorem 2 m the special case where the coefficients an' constants (Hint Recall 
the proof of Theorem 2, Sec 2 1, and use the result of Exercise 10 ) 

13 Prove Tlieorem 3 

f V eos nl — < os n\ 

14 Show that the integral In i dt satishes the equation 

yo eos I — cos X 

I/;* - (2 cos \)E T 11/ = 0 

Solve this erpiation, and find an explicit I'xpression for /„ 

16 Discuss the solution of each of the following eiiuations 

a Ky “0 b Ey = <t>{x) 

c (ao-fc’’ -f (.i\E)y «■ 0 d {a^E^ 4 aiE)y — <ft{x) 


4.6 

The method of least squares 

piohleni of (Mirvo fit ting admits of two somewhat difTerent 
mtcTprelalions In (he hrst place, we may ask for (he eipiatioitof 
a curve of [irescnhed type which jiasses exactly Ihiough each 
point of a given set hor iiolynomial cuives (his is most easily 
acconifilished by means of mteipolatioii foimulas such as we 
developed in Sec 4 2 On (lie other hand we may weaken these 
requirements and ask for some simjilor curve whose equation 
contains loo few fiarameters to peiinit it to [lass exactly through 
each given point hut whieh eomes “as < lose as possible” to each 
point. Foi instance, given a set of iiomis as m Fig 4 4a, a straight 
line passing as close as possible to each point may vciy well be 
more useful than some eonqdicated curve passing exactly through 


FIGURE 4 4 

The approximate 
fitting of a 
straight line to a 
set of points 



(a) (b) 
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( 1 ) 


( 2 ) 




each point This will certainly be the case with experimental data 
which theoretically should fall along a straight line but which fail 
to do so because of errors of observation The necessary measure 
of *‘as close as possible” is almost universally taken to be the 
least-square criterion,* and the process of applying this criterion 
IS known as the method of least squares, which we shall now 
develop 

Let us begin by supposing that we wish to fit a straight line / 
whose equation is 


y = a hx 

to the n points (i‘ 2 ,y 2 ), , (j'u.l/u) Since two points 

( ompletely determine' a straight line, it will in general })t‘ impossi¬ 
ble for the requiied line to through more than two of the 
given points, and it ina^' not {lass through any, Hence, the 
cooidinates of the general point will not satisfy Eq (1). 

That 1 ^, when we substitute i, into I'h] (1), wn' get, not y,, but 
lather the ordinate of /, vrhich, as we see in Fig 4 46, differs from 
?/, by St In othei words, 

f/i — (a + hxt) = St 0 

If we compute the discrepancy 5, for each point of the set 
and form he sum of the sijuares of these quantities (in order to 
prevent large positive and laige negative 5's canceling each other 
and theieby giving an unw'arranted impression of accuracy), we 
obtain 


n 

F -- ^ oh = {//i — n — 6 ^ 1 )“^ + ( 1/2 — a — 6 j'2)“ 

I =. 1 


-f (vn — tt - 6r„)2 

The quantity K is obviously a measure of how well the line / hts 
the set ol points as a whole 1 m )1 I'J w ill be zero if and only if each 
of the points lies on /, and the largei K is, the farther the points 
are, on the avi'iage, troin / 44i(‘ least-square critinon is now 
sirnjily this that the parameters a and 6 should be chosen so as to 
make the sum of the squares o] the deviations E as small as possible 
IV) do this, we ap[)lv the usual conditions for minimizing a 
furietion of several variables and equate to zero the two first 

partial derivatives, ^ and This gives us the two equations 


^ = 2(^1 — a — 6xi)( —1) -f 2 ( 2/2 — a — bx 2 ){ — l) + 

+ 2{yn - a- bxn){-l) = 0 
^ = 2 ( 2/1 - a - bxi){-xi) -h 2 ( 2/2 - a - bx 2 ){-X 2 ) “b 

-f 2(2/n — a — hXn)(—Xn) = 0 


* A brief discussion of the reasons for this will be found in A M Mood, 
"Introduction to the Theory of Statistics," p 311, McGraw-Hill Book 
Company, New York, 1950, 
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laa 


(4) 

(5) 


or, dividing by 2 and collecting terms on the unknown coefficients 
a and 6, 

n n 

na + 6 J a:, = ^ y. 

i-i 1-1 

n n n 

o ^ + b £ X,* = 2) ^•t/* 

t-1 i-l 1-1 

Equations (4) and (5) are two simultaneous linear equations 
whose solution for a and b presents no difficulty 

For 7 = 1, 2, - , (2) defines a system of n equations in 

the two unknowns a and b which should, ideally, be satisfied, 
but which actually are not Moreover, minimizing E is nothing 
more than minimizing the sum of the squares of the amounts by 
which these n equations fail to be satisfied 

The preceding observation suggests a somewhat more general 
point of view, namely, that the method of least squares is simply 
a process for finding the best possible values for a set of m un¬ 
knowns, say xi, X 2 , , Xm, connected by linear equations 

^11^1 flliTz 4- 4“ = bi 

(^ 2 lX\ 4“ (I22X2 4" 4“ (l 2 mXm = ^2 


0 >n\XY 4“ 2^2 4” 4“ OtnmXm — bn 

when n > m F’uce the number of equations exceeds the number 
of unknowns, the system presumably does not admit of an exact 
solution, 1 e , there is no set of values for xi, X 2 , , Xm for 

which each equation is exactly satisfied Hence, we consider the 
discrepancies 

6, = a.ixi 4-a»2J’2 4- a.^Xm — b, 7 ^ 0 i=l,2, ,n 


and attempt to find values for xi, X 2 , 


E = ^ 6,2 = ^ (a,ixi 4- 0 , 2 X 4 4- 


, which will make 
4“ dtmXyn 


as small as possible 

To minimize E we must equate to zero each of its first partial 
derivatives 


dll dX2 ’ aXm 

dE 

For this gives the equation 


dx\ 


n 


= I 2(“. 


1X1 4 “ 0,2X2 4 “ ’ 


or 


xi ^ o,io,i 4“ X 2 ^ 0,10,2 4“ 


»-i 


4- a,^x„ - 6,)(a,i) = 0 


^ dildtm 
1-1 


n 



1-1 


■ 4“ Xm 
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and similarly, for the other partial derivatives, 

n 71 n 71 

xi ^ -h ^2 a^2a^2 + ‘ Xm ^ a, 2 ^, 

1-1 i»i 1-1 1-1 


*rI ^ “f” J 2 ^ fli7nfli2 “1“ ‘ “1“ .I'm ^ ~ ^ ®i7n^^i 

1 — 1 t—1 » — 1 

Wc have thus obtained a system of m linear equations m the ri 
unknowns x\, , Xm, whose solution is now a routine 

matter As a practical detail, it is worthy of note that these 
ninnmizing conditions, or normal equations, as they are usually 
called, can be written down at once according to the following 
rule 

rule 1 Jf each ol n lm(‘ai equations in th(‘ unknowns 
ri, J‘2, , .r^ n > m 

IS multiplied by the coeffunent of .r, in that eqiiaticni, the sum of 
the resulting ecjuations is th(‘ ?th normal ecpiation in tfie least- 
s(piare solution of the sysU^ru 

EXAMPLE 1 

By the nielhod of least squao's, fat a parabolic cciuation 1 / = a + + rx^ to the data 


J 

-3 

_2 

0 


4 

y 

18 

10 

2 

2 

1 _i 

5 

1 _ 


Siil).slitiitiiiK these pans of values irilo thi* eiiuiitum // = a -f 4 car*, ue find that a, b, 
and r sfioiild sal isfy the conditions 

a - 3b + 9r = IS 
a — 2b 4- 4c = 10 
a at 2 

a 4- 3b + 9r = 2 

a -|- 4/; 4“ 16c = 5 

In Keneral, thr('e unknowns cannot la* made to satisfy more than three conditions, hence, the 
most we can do is to deteiinine vakieh of o, b, and c w hicli will satisfy these equations as nearly 
as possible 

To set up the first of the three normal ei^uations required !>;> the method of least squares, 
w(“ must multiply eat h (jf the equations of condition by the coefheient of a in that equation 
and add, RcttiriK m this ease simply the sum of the five equations 

5a 4“ 2h 4 - “ 37 

To set up the second normal equation, we multiply each equation by the coefficient of b in that 
equation and add, getting 

— 3a 4- 95 — 27c “ —54 

-2a 4- 45 - 8c » -20 

04 - 04 - 0 = 0 

3a 4- 95 4- 27c “ 6 

4a 4- 165 + 64f - 20 


2a 4- 385 -f 56c - -48 
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In the same way, multiplying curl) equation by the coefFinent of r in that equation, we get the 
third normal equation 

9a - 276 + 81r = 162 
4a - 86 + 16r - 40 
0-1-0 4- 0 * 0 

9a + 276 4- 81r =• 18 
16a 4- 646 4- 2r56r = 80 
38« 4h 566 4 434c = 300 

The solution of the three normal equations is a simple matter, and we find 
rt = 1 S2 6 = — 2 65 c = 0 87 

The required solution is therefore 

?/ = 1 82 - 2 65j 4- 0.87J-2 

When, as is often the ease, the abscissas of the points to 
which wo wish lo fit a polynomial curve are eipiallv spaced, the 
labor involved in the least-sipiare yiroci'dure w(‘ have jnst de- 
s(u ibed can be significantly leduced by using vvdial are knoun as 

orthogonal polynomials. 


DEFINITION 1 

If n -b I polynomials of lespective degr(M‘s fti ^ 0, 1, 2, , n liave the 

proiierty that 

n 

( 6 ) I =0 j ^ L 

j- = 0 


they are called orthogonal polynomials. 


( 7 ) 


By methods which need not coneern us here,* it has been sliown 
that, for each ii, there exists a set of n -f 1 orthogonal poly¬ 
nomials, and the general formula for them has been obtained 




= I r OS': 


»'<= 0,1,2, 


In particular, 
/*.o(.r) = 1 

e„,(r) = 1 - 
}\M = 1 
C„,(x) = 1 


, .r(r - 1) 


• > - + 7-, % 

71 7i(n — 1) 

12 + ;io■’’b” - 20 - , 

n n{n — 1) — l)(a — 2) 


1) 


.r(i - l)(i- - 2) 


tMcarly, for cacti m ^ n, any iiolynomial of degree m can lie 
expressed as a linear eoinlunation of the polynomials 

Pn«(r), e„.(r), . , 


• See, for instance, W E Milne, “Numerical Analysis,*’ pp 265-275 and 
375-381, Princeton University Press, Princeton, N J , 1949 
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for the expression 

(8) P{x) = OoPnoW -f- aiPnl(x) + ’ ' ’ + dmPnm{x) 

is obviously a polynomial of degree m containing the maximum 
number, m -f 1, of independent, arbitrary constants which can 
appear in the general polynomial of this degree. Moreover, the 
coefficients Oo, Oi, . , m (8) can easily be found. For, if we 
multiply both sides of this identity by Pni(x), say, and then sum 
from x = 0 to j = n, we get 

n n n 

X P{x)l\Xx) = a» X I\Xx)PnXx) + • + a. X i’nXix) + 

x — O x“0 x“»0 

n 

^ I nmix^f ni(-r) 
x-0 

But, from the so-called orthogonality property of the polynomials 
(/* 7 im( 2 )|, which IS expressed by Fq ((>), it follows that every 
term on the right-hand side of the lasf expression is zero except 
the sum 

n 

a. X J‘nX{x) 

x-0 

Hence, sol ng for a,, we obtain the formula 
X C(x)C„.(t) 

(9) a. = - > = 0, 1, , m 

X 

x-0 

The property described by (b) is a very important one and 
we shall encounter it again in Sec 11 2 when we attempt, in a 
manner analogous to the expansion (8), to express an arbitrary 
vector as a linear combination of certain given, independent 
vectors Also, in (ffiaps. 6, 8, and 9 we shall study expansion prob¬ 
lems resembling (8), in which the coefficients will be determined 
through the use of orthogonality properties involving integrals 
rather than sums, as in (0) 

Clearly, an expansion of the foim (8) can be created for any 
function /(j-), polynomial or not, merely by using the coefficient 
formula (9) with/(j) replacing P{x) Such expansions are of great 
importance, for, although it is obvious that they cannot represent 
f(j) exactly unless i{x) is a polynomial of degree n or less, they 
provide the best jiolynomial approximations to f{x) in the least- 
square sense To prove this, .suppose that we have a function 
/(j) defined for the n I equally spaced values x = 0, 1, . , 

which we wish to approximate with a polynomial of degree 
m (<n) If we assume the polynomial to be written in the form 
(8), the discrepancy at the general point x is 

fix) floFno(3^) OftP n\ix) 0>mP nm(x) 
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and the principle of least squares requires that we minimize the 
sum 


(10) £ = ^ [f{x) — aoPno(x) — ' • • — a,Pm(x) — • • — a^Pnm(x)Y 

I ■ 0 

If we equate to zero the derivative of E with respect to a,, say, we 
obtain the general minimizing condition 

n 

^ 2lf(x) — aoPno(x) — — arPnt(x) — — amPrim(x)]Pni(x) = 0 

Z-0 

or, breaking up the sum, 

n n 

X fiT)P.,(x) -a„l PMx)PUx) - 

Z-0 i-O 

n n 

- a. X Pn.Hx) - - a„ X = 0 

j■0 z“0 

But, from the orthogonality of the /*’s, the sums involving two 
different /*’s are all zero, and Eq (11) reduces to 

n n 

X f(x)P„,{x) - 0, X = 0 

or 

X 

(12) »■ '= - >= 0 , 1 , ,m 

X P.,Hx) 

T-0 


da, 


(11) 


( 13 ) 


which IS exactly the same as (9) with P(x) replaced by f(x) 

The advantage of using orthogonal polvnomials is now cleai 
In the first place, through their use the coefficients m the least- 
squaie polynomial aj>pioximation to a function /(x) defined for 
the + 1 equally spaced values a - 0, 1, . , 7t can be found 

one at a time without the nei’c^ssity of solving any simultaneous 
equations In the second place, since Formula (Ei) for a, does not 
involve 777 , the degree of the })olynomial we are fitting to the data, 
it follows that, if w'e desire to increase 777, that is, add another 
term to the approximating polynomial, all previously calculated 
coefficients remain unchanged and only the coefficient of the new 
term need be computed 

The sum appearing in the denominator of (12) need not be 
calculated directly because a general formula for it is available, 
namely, 


X p«.*(i) 

x-O 


(n + t + l)<'+‘> t 
(2i + l)(n)w 


t See, for instuice, Milne, loe. ctl 
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(14) 


In particular, 

n 

^ Pn 0 ®(a:) =71 + 1 

I — 0 

I “ 0 

2 + Oi" + 2)(n + 3) 


2 = 


5n(n — 1) 

( n + l){n + 2) (n + 3)( n + 4) 
7n(7i. — l)(7i — 2) 


To determine the accuracy with which the polynomial 
apiiroximation fitn the data it is not necessary to compute E from 
(10), .since it can ho shown that, in general, 


^ = 2 PM - 1 w i c„.^(x)] 


EXAMPLE 2 


Using orthogonal polynomials, fit equations of the form y = ao + ai<and y -= Oo T Oii + 02 ^* to 
the data 


t 

0 ut) 

0 25 

0 50 

0 75 

1 00 

y 

0 00 

0 06 

0 20 

0 00 

0 90 


As a first stop wo must introduce an auxiliary variahlo x ^ 4l which will take on the values 
0, 1, 2, 4 when t takes on the given values (1 00, 0 2.^), 0 .'iO, 0 75, 1 00 Then, because there are 

five given points to which the reiiuired cuives are to be fitted, we observe that n -j 1 = 5 or 
n =* 4 Next, lacking tables of the orthogonal polynomials, we must compute Uie values of 
Pio(x), and Pi<(x) foi the five values x ^ 0, 1, 2, 3, 4 This is a simple matter, of course, 

and the values shown in the accompanying tnble can be calculated at once It i*. then necessary 
to compute the sums of the products of the respective values of the y’.s and each of the P'tn 
These products are shown in the last three columns of the table 
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In terms of t, the line of best fit is therefore, 

y - H- a^Pn{x) - 0 3520 ~ 0 4680 

and the parabola of best fit is 

y “ aaPnAx) + aiP4i(-r) + atPiiix) 

= 0 3520 - 0 4680 ^1 " ^ T 

= -0 0103 + 0 0226J- -f 0 0529 t> 



-0 116 + 0 234x 


Then, by settinK x “ 4t, we obtain the eurves of best fit for the data as oriKinally given 
?/ = -0 116 -h 0 936f and ?/ = -0 0103 -|- 0 0904^ + 0 8464^2 

IJaing Eq (14) we find that tlie sum of the squares of the departures of the j)()it»ts from the 
line and from the parabola of best fit are, respectively, K{ = 0 0465 and E’l = 0 0074 From 
the relative size of and E) ne conclude that the parabola fits the data significantly better 
than the straight line does 


In many inifiortant applications the position of a moving; 
oliject IS observed at a senes of equally spa(*(‘d times, and its 
velocity and acceleration aie letiuired at these times ("learly, 
these can be estimated by using the formulas for numerical 
difterentiatioii we obtained in Sec 4 3 However, since the 
interfiolation polynomials from which these formulas of numerical 
dilTerentiation were derived ht the raw data exactly, they and 
any formulas based on them are seriously influenced by even 
small errors m the data On the other hand, a polynomial curve 
fitted to the data or a ])ortion of the data by the method of least 
sipiares will be less influenced Viy random errors and will represent 
more nearly the underlying, presumably smooth trend of the 
data Hence, derivatives computed from such approximating 
functions will in general be more accurate than those computed 
by differentiating interpolation polynomials These ideas are 
illustrated geometrically m Fig 4 5, where it is clear that the 


FIGURE A.5 

The relative 
Bmoothness of an 
interpiolation 
polynomial and a 
leaat-square 
approximation to 
a Bet of poir^tB. 
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(15) 


slope of the interpolation polynomial fluctuates markedly from 
point to point, whereas the slope of the least-square approxima¬ 
tion changes in a smooth fashion, which is almost certainly a 
more reliable description of the trend the data would exhibit if 
free from random errors 

In applying these considerations to the analysis of observed 
positional data, it is customary to fit a polynomial curve of rela¬ 
tively low degree, say a parabola, to successive sets of 5, 7, or 9 
observations and then take the ordinate and the first and second 
derivatives of this approximating iiolynomial at the central point 
of the set as the corrected, or "smoothed,” position, velocity, and 
acceleration of the body at that instant 

To illustrate this technique, let us use the method of orthog¬ 
onal polynomials to fit a parabola to tlie five points 


t 

X 

-2h 

0 

- h 

1 

0 

2 

h 

.S 

2h 

4 


To do this, we use the coefficient formula (12) and the values of 
/%(i(j), ), and /% 2 (-r) tabulated in Example 2. The results are 

found immediately to be 


- ^-2 + ?/-l -f </0 -f- Vl + 

5 

2 / //_i !Ji \ 

^ 5 ^ " 2 “ '^7 

2 / v-i yi , \ 

^ - i/o - Y + y-‘j 

and thus the formula for the approximating polynomial is 
4o(.r) T diP 4i(^) T o,iP 

= - (2/_2 T y~i T yo + yi T y2) 

o 

When a- = 2, we find for the smoothed mid-ordmate 


Yo = - 


— 37/_2 -T I2i/_i ~l~ 17^0 -f~ 12^1 — 3T/2 


35 


To approximate dy/dl, we recall that x = 2 -1- hence 

dy __ dy dx 1 dy 
dt dx dt h dx 


(16) 
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(17) 

( 18 ) 

(19) 

( 20 ) 


Therefore, differentiating (15) with respect to x and then setting 
X = 2, we find for the smoothed value of the first derivative at the 
central point of the set 

V' - H- g/i H- 2j /2 

^ lOA 

Similarly, a second differentiation would yield 
y,, _ 2y^2 - y-i - j yo - yi + 2y2 

as the smoothed value of the second derivative at the central 
point of the set However, it is better to find by applying 
Formula (17) to the table of the smoothed first-derivative values, 
getting 

" \0h 

or, replacing each derivative by its expression in terms of the 
appropriate ?/-values from (17), 

yif _ 4/y-4 "h -^y-A -h .V-2 ~ ~ 10//0 — 4iyi -j- Va "b 4//;, 4 j/4 

* 100//2 

Since Kqs (16) and (17) requiie a knowledge of two ordinates 
on each side of those being smoothed it is evident that these 
equations can be used only for points after the second and before 
the (n — l)st in a table of data Similarly, l^^irmula (20) for the 
second derivative can be used only between the hfth and the 
(n — 4)th points, inclusive I'o smooth to the ends of a table we 
must derive auxiliary formulas from Eq (15) by evaluating it 
and its derivatives at — 0, 1, 3, and 4 as well as at x = 2 
These results will be found among the exercises at the end of this 
section In general, central formulas, that is, foimulas in which 
the element being smoothed is as near as jiossible to the central 
member of the set of data appearing in the smoothing formula, 
should be used wherever [lossible 

The method of least squares is not limited in its application 
to problems in which the equations of condition are linear Some¬ 
times, by a suitable transformation, the problem can be con¬ 
verted into one in which the parameters do enter linearly For 
instance, to fit an equation of the important type y = we 
can take the natural logarithm of each side, getting 

In T/ = In a -h bx 

Then, considering x and In y as new variables, say A" and F, and 
In a and h as new parameters, say A and B, we can regard the 
problem as requiring the determination of A and B such that the 
linear equation 


Y ^ A ^ BX 
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gives the best possible fit to the known jiairs of values of A" (= x) 
and y {- In ?/) Onre A has been found, it is, of course, a simple 
matter to find the actual f)arainetcr a, since .4 = In a 

Similarly, the fitting of a function y = kr^ can be reduced 
to a linear pioblem by first taking logarithms (preferably to the 
base 10), getting 

log // log k -f log X 


This equation is linear in the parameters K = log k and N = n 
TIenre tlie dot(u niination of th(‘ parameters can be earned out as 
outlined above 

On the other hand, it is not possible to make a rigorous 
linearization of gcnieral svKt(‘ms of nonbinnir (‘(pjatio/is of condi¬ 
tion Hut if a reasonabli' ap)»ioxiiuatioii to a solution of such a 
system is available, an a|)proxiinate liinnirization ot th(‘ problem 
can be achievi'd in t,h(^ following way 

Let th(‘ ('(Illations to Ix' satisfied (as in'arlv as jiossible) be 


/i(l//) 0, L2(J.V)-0, . 


and suppose that is known, by in-'pection or otherwns(>, to 

be an a})proximate solution of tins ^vst(‘n) Then w'e ('an ('xjiand 
each func^'on /»((,y) ni a g(*n('ializ('d d^avloi senes about tfie 
point (xn,VoJ, getting 


/.(t,'y) = L(io,y/oj + ' 1 (i - »•)) -f ^ I (// 

o ( [TO ya Ol/ JJ'ii.Vn 




... I (i — J (}} +2 

d r~ wo <} < 0// 'j'o j/o 


4 ! (// " //o)' 

ay~ 


Vn) 

{i ~ ro)(?/ - //o) 

-h 


Xow', if (ro,i/o) is a reasonabfi' approximation to the required 
solution, the (|uantjti(‘s < — m and // -- yo will be small, and 
luaice their sipiares, jiroducts, and higher |rowans wnll be negligible 
in coinpaiison with the (plant it k's themselves Omitting these 
t(‘rms thus I educes the set (21) to the system 

M-r,!/) = /.(Jo.Vo) + f‘\ (< - 1 (V - Vo) = 0 

nr 'j-n.j/n ay Ij-o.j/o 


whu'h IS hn(*ar in the unknown corrections r — iq and y — yn 
The method of least s(piares can now^ be applied to tlie system 
(22) in a straightforward way, following which the preliminary 
estimate (.ro,?/()) can be apjrrojrnately corrected Of course, if 
desired, the given funrtions /,(j,,v) ran he expanded about the 
coirected solution ((i,/yi) and the proeess repeated The extension 
to systems with more than tw'o unknowns 


) = fl, / 2 (t,(/, 2 , ) = 0, , fn{t,y,z, .) = 0 


IS immediate 
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EXAMPLE 3 

Fit an equation of the form y — fcj" to the data 


X 

1 

2 

3 

4 

jlI 

2 500 1 

8 000 1 

19 000 j 

50 000 


and compute the value of E 

First let us work the problem by using the logarithmic equivalent 
log 7/ = log /C -f- 71 log J* 

of the function we are trying to ht to the data Then the equations of condition are 
(J 397^1 = log h 
0 9031 = log k T 0 301071 
1 2788 == log k + 0 4771/1 
1 6990 « log ^ 4 0 6021/1 

and from these, by the usual process, we obtain the norma) equations 
4 0000 log k 4- 1 3802n = 4 2788 
1 3802 log A 4 0 0807a = 1 9049 

From these w< f nd log A: 0 3472 and n = 2 096 Hence, A = 2 224, and the required function 
is 

1/ = 2 224j* o"® 

'I'o find E we must evaluate the function y = 2 2243'*"*" for r = 1, 2, 3, 4, subtract these 
results from the corresponding values of y ns originally given, square these differences, and add 
them The work is shown in the folloviing tabh 


X 

^ ( = 2 2243- * "*«) 

V (given) 

6 

6* 

1 

2 224 

2 500 

0 276 

0 076 

‘J 

9 510 

8 000 

-1 510 

2 280 

3 

22 243 

19 000 

-3 243 

10 517 

4 

40 655 

50 000 

9 345 

87 329 



1 


E - 100 202 


Although we have no real basis for such a conviction, this \nlue of E should strike us as 
discouragingly large, cHpccially in view of the fact that we have tried to choose the* parameters 
A and n to make it as small as possible To explore the matter further, let us reconsider the 
problem in a more elementary wav and determine k and n so that the curve will pass exactly 
through the points (3,19) and (4,50) w itliout regard to the remaining pair of points This requires 
that 

19 ■» A-3" and 50 = A'4" 

Dividing ten Seepnd equation by the first giv'ps us (44)" = Hence, taking logs, 

log 50 — log 19 
log 4 - log 3 


3 36 
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With n known, il is easy to find k from ttie equation 19 » 

\o^ k = log 19 - S m \oft S = 9 and k - 9 474 

Now, for the function y = 0 474j® the calculation of E leads to the following results 



1/ (= 0 474^* *") 1 

V (given) 1 

-f 

* 1 

6’ 

1 

0 474 

2 500 

2 026 

4 105 

2 

4 865 

8 000 

3 135 

9 828 

3 

19 000 

19 000 

0 000 

0 000 

4 

50 000 

50 000 

0 000 

0 000 

E = Kr933 (!)” 


This is a remarkable improvement in the closeness of fit, which surely requires cxplanatam 

The question will become clearer if w'e eonsidei the Mims of tlie squares of the errors asso¬ 
ciated with the respective functions </ ■= - 224r^"’*'* and j/ = n 474j-* **' when they are wiitten 
in logarithmic form 77ieBe are 


jr 

log 7/ (= log 2 224 + 2 090 log j) 

log 1 / (given) 

1 

1 S 

1 


1 

0 3471 

0 3t)79 

1 0 0508 

0 00258 

2 

0 9782 

0 9031 

-0 0751 

0 00564 

3 

1 3472 

1 2788 

1 - 0 0684 

0 00468 

4 

1 '991 

1 0990 

0 0899 

1 

0 0080S 

£ = 0 02098 


and 


T 

log y (= log 0 474 -f .3 36 log x) 

log // (given) 

--J 

5 


1 

-0 3244 

0 3979 

0 7233 

0 52172 

2 ' 

0 6871 

0 9031 

0 2160 

0 04666 

3 

1 2788 

1 2788 

0 0000 

0 00000 

4 

1 0990 

1 

1 6990 

0 0000 

0 00000 

K = 0 56838 


The function 7/ = 2 224 j* """which wr fitted logant hmicallY by the method of least squares 
fits the logarithms of the data much better than does the second function we derivi d Moreover, 
it does this by keefiing the discrepancies 5, about equallv small Howi'ver, a given dilTerence iS in 
the logarithms of two numbers represents only a small difference in the numbers if the logarithms 
are near zero, but represents a large difference if the logaiithnis themselves are large Thus, for 
a change of 0 1(KK)0 in the logarithms, we might liave either 

0 lOOOO = logarithm of 1 259 
0 OtK)0() = logarithm of 1 000 
Difference of the numbers = 0 2.’)9 

or 1 COOOO “ logarithm of 39 811 

1 50000 = logarithm of 31 623 
Difference of the numbers = 8 188 

Hence, the average approximation to the original data is significantly improved by keeping the 
errors in the larger logarithms as small as possible, even at the exyiense of considerably larger 
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errorfl in the smaller logarithms And, clearly, there is no reason to believe that the function 
wlu,di best fits the logarithms of the data will necessarily give the best approximation to the 
data themselves 

As a final approach to the problem, let us now 1r> the general method of handling nonlinear 
equfltions of condition Assuming again an equation of the form y = kx^ and substituting the 
four giv^ui sets of values, we find that k and n should satisfy the conditions 

2 5 - A: 

8 0 •= ^ 2 " 

19 0 « A:3" 

50 0 - kA- 


As an mitial estimate of the values ot k and n, let us use the values k = 0 474 and n — 3 36 
which we obtained by passing the curve exactly through the points (3,19) and (4,50) Then 
expanding each of the equations of condition in a Taylor senes around (0 474,3 36), we find 


/, « A: - 2 500 - -2 026 4- (A- - 0 474) - 0 
/i ST- fc2" - 8 000 == (4 865 - 8 000) 4- 2" ' 


{k - 0 474) 


|0 474,3 30 

+ A2Mn 2 I 

|0 474.3 36 

- -3 135 4- 10 267(A - 0 474) 4 3 372(n - 3 36) - 0 


(n ~ 3 36) 


/, » A'3'‘ - 19 000 = (19 000 - 19 000) 4- 3 


|0 474 , 3,36 
4- A:3Mn 3 


(A: - 0 474) 

I (n - 3 36) 

10 474,3 36 


- 40 098(/f - 0 474) 4- 20 S74(n - 3 36) - 0 

/4 kA- - 50 000 = (50 000 - 50 000) 4- 4" | (^ - 0 474) 

10 474,3 36 

4 ^4" In 4 I (n - 3 36) 

10 474,3 36 


- 105 411 (it - 0 474) 4 69 3l4(n - 3 36) = 0 


betting u = k — 0 474 and e -« n — 3 36, the approximate equations of condition arc, therefore, 


u - 2 026 

10 2677,<-h 3 372y-3 135 
40 098u 4 20 87 4e - 0 000 
105 AUu + 69 314e = 0 000 

The eonstruction of the normal equations, by multiplying each equation of condition first 
by the cocfheient of u and then by the coefficient of v in that equation and adding, is a routine 
matter, and we find without difficulty 

12,825 7401/ 4 8,178 084e - 34 213 
8,178 084u 4 5,251 525e - 10 571 
Hence, u » 0 197 and v — —0 305 
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and tl\e corrected eetimateB of P and n are 

)c - 0 474 + 0 197 » 0 671 
n = 3 36 - 0 305 = 3.055 

For the function y = 0 671i* a etraig^htforward calculation yields E = 2'2 62H, which ib atill 
not 80 Bmall as the value we found for the curve that pasHed exactly through the points (3,19) 
and (4,50) However, a second application, hawed upon expanding the equations of condition 
around A: = 0 671 and n = 3 055, yields the improved values 

A: = 0 733 and n = 3 039 

and E “ 10 052, which is the emallest value of E we have yet found Another repetition of the 
process would no douht improve this slightly 

EXERCISES 

1 Fit a straight line to the data 


X 

1 

3 

6 

7 

9 

y 

1 

5 

6 

10 

12 


(a) by minimizing the sum of the squares of the vertical distances from the points to the 
line, and (b) by minimizii the sum of the squares of the horizontal di.stances from the 
points to the line 

2 Fit an equation of the form y = a hx cj’ to the data 


X 

-1 

0 

2 

3 

5 

y 

-4 

4 

8 

9 

7 


3 Find the most plausible values of x and y from the following system of equations 

X 4 y =- 2 
2x - 3y - 9 
20x 4- 16i/ ■» 4 

(a) without dividing out the factor 4 from the last equation, and (b) after dividing out 
the factor 4 from the last equation Explain 

4 Fit equations of each of the forms 

a ax by — 1 ™ 0 b ax + j/ — c“0 c x by — c ™ 0 

to the data 


X 

0 

1 

2 

a 

V 

1 1 

1 9 

3 0 

3 9 


by minimizing the sum of the squares of the amounts by which each of the equations, m 
turn, fails to be satisfied Compare the results and explain the differences 
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5 r Verify that 


£ P,o(x)/’.,(i) - 0 £ P„o(x)P.,(i) - 0 £ P„(i)P„(i) - 0 


b Verify that 


n 

1-- 


Hr) - n + : 


T-0 


(n -|- l)(n + 2) 


3n 


^ Pnl^{x) 
a :-0 


(n + l)(n + 2)(n + 3) 
57i(n — 1) 


c Express j and as series of the form 

aoPno(x) 4- aiPni(x) + aiPmix) + 


6 Using orthogonal polynomials, fit functions of each of the forms y = a hx and y = 
a + bx +- ci* to the data 


X 

0 50 

1 00 

1 50 

2 00 

2 50 

3 00 

y 

1 01 

1 08 

1 16 

1 25 

1 29 

1 30 

and comput(! the value of E for each approximation 

Fit an equation of the form y = to the data 



X 

> 

2 

3 

4 



V 

1 65 

2 70 

4 50 

7 35 




a By first taking logarithms and then working with the linearized equation 
In y — In A -f- aj- 

b By first obtaining approximate values of A and a and then linearizing by expanding the 
equations of condition in Taylor’s scries around these values and retaining only the linear 
terms. 

8 Derive the following modifications of Formulas (16) and (17) 


To “ -f- 9f/i — 3 i/ 2 — 5t/i T 3y») 

To - ( —54yo + 13yi + 40i/j + 27j/i - 2Gv4) 


and Fo " + 13yo -b 12yi + 6 vj ~ 5yi) 

(-34y„, 4- 3i/o 4- 20y, + 17^2 - 6vi) 

i\m 

9 Derive Formula 14 

10 It is desired to fit a circular arc to a set of points {x\,y\), , {xn,yn) Discuss the relative 

merits of doing this by minimizing the sum of the squares of the vertical distances from the 
points to the circular arc and by taking the equation of the circle m the form j* + 4- 
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ax H- 6j/ 4- c “ 0 and minimizing the sum of the squares of the amounts by which the 
coordinates of the points fail to satisfy this equation 
11 It 18 desired to fit an equation of the form y — to a set of points (X],i/i), , {xn,yn) 

By observing that y must satisfy a certain linear, constant-coefTicient, first-order difference 
equation, obtain the following equations of condition 

j/2 - e“i/i “ 0 
yt — e^ys * 0 


Vn - c“yn-i - 0 

Show how A can be found aftei the best least-square approximation to a has been found 
from these equations Discuss the advantages of this method relative to the method of 
linearizing by taking logarithms and the general method for handling problems in which 
the parameters enter nonlmearly 

12 Explain how the method of Exert ise 11 can be extended to the fitting of functions of the 

form y = -}- 4 AV*' 

13 ?]xplain how a continuous function can be approximated over an interval ia,h) by minimiz¬ 
ing the integral of the squared difference between the given function and the chosen approxi¬ 
mation Illustrate by approximating the function cos x over the interval (0,7r/2) with a 
function of the form y — a — 

14 Approximate the solution of y" -|- xh/ = sm x for which 7 y((b — y(7r) — 0 by assuming 
y = A sin X and choosing to minimize the integral from 0 to tt of the square of the amount 
by which A sin x fails to satisfy the differential equation 

16 Show^ that if a line with equation x cos 6 4 v sin 6 - p = i) fitted to a set of points 
ix],yi), , (Xn,i/ri) by minimizing the sum of the squares of the perpendicular distances 

from the points to the line, the value of 0 is given b^ the formula 


tan 26 = 


2rjr„( 


where Cr and (t^ are, respectively, the so-called standard deviations of the x-values and the 
y-values. 


'“W"2 "''“(IW”i 0 ’ 
1-1 1-1 

lent of correlation between 

^ X ~ X X 


and 

n ’ 

,-1 ,-i i-l 1-1 

and rjj, is the coefficient of correlation between the x-values and the y-values, 


What IS the value of p in the equation of the line of best fit? 




CHAPTER FIVE 


Mechanical 

and 

Electrical Circuits 

5.1 

Introduction An examination of the application of differential equations to 
mechanical and electrical systems is valuable for at least tA\ o 
reasons. In the first place, it will furnish us with useful informa¬ 
tion about the behavior of certain physical systems of great 
practical interest Second, and jiorhaps more imjiortant, it will 
jirovide a striking example of the role whi(‘h mathematics ))lays 
in unifying widely differing phenomena For instance, we shall 
see that, merely by a renaming of the variables, the analysis of the 
motion of a weight vibrating on a spring becomes the analysis of 
a simple electrical circuit Mou'over, this correspondence is not 
rnerel}" qualitative or desciiptive It is (piantitative, in the sense 
that if one is given any of a wide variety of vibrating mechan¬ 
ical systems, an electrical circuit can be constructed whose cur¬ 
rents or voltages, as jireferied, will give the esact values of the 
displacements m the mechanical system when suitable scale 
factors are introduced Since electrical circuits are easy to 
assemble and since currents and voltages are easy to measure, 
this affords a jiractical method of studying the vibration of com¬ 
plicated mechanical conhgurations, such as engine crankshafts, 
which are expensive to make and modify and whose motions are 
difficult to record accurately * 


5.2 

Systems with one degree of freedom 

A system which can be described completely by one coordinate, 
1 e , by one physical datum such as a displacement, an angle, a 


* Of courBc, incctialrk-al modi'lH of oloctriral circuits can also be constructed, 
but there is little practical reason for constructing them 
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current, or a voltage, is called a system of one degree of freedom. 
A system requiring more than one coordinate for its complete 
description is called a system of several degrees of freedom. A 

single differential equation suffices for the mathematical descrip¬ 
tion of a system of one degree of freedom A set of simultaneous 
differential equations, as many equations as there are degrees of 
freedom, is necessary for the analysis of systems of more than one 
degree of freedom. We shall begin our investigations by consider¬ 
ing, as prototypes of the general system with one degree of 
freedom, each of the configurations shown in Fig. 5 1 In each 
case we assume that all the elements of the system are concen¬ 
trated, or lumped. In other words, such things as the distributed 
mass of the spring iii F'lg 5 U;, the distributed moment of inertia 
of the shaft m Fig. 5 \b, and the resistance of the leads in Fig 5 Ic 
and d we assume to be either negligible or taken into account 
through suitable corrections added to the corresponding major 
elements * 


^Spring k 


Weight ad 


[ Disturbing 
force F 


FIGURE 5 1 

Four simple sys¬ 
tems of one 
degree of free¬ 
dom (a) trans- 
lational- 
mocli.mical {h) 
torsioiial- 
meeliHrucal, (c) 
seriCH-electTK al, 
(d) parallel- 
elertrieal 


I Am I D'l^hpot, or 
friction c 


(a) Coordinate -- vertical 

displacement of weight y 


Resistance Capacitance 
R (' 


ft 


0 Impressed 
voltage E 


Inductance L 


Elastic 
shaft k 


Friction 
device ( 


Moment of 
inertia I 



Disturbing 
torque T 


{h) Coordinate - angular 
displacement of disk 6 


Inductance L 



(c) Coordinate ^ current i, 
flowing around loop 


(d) Coordinate ^ common voltage e, 
between nodes A and B 


* In many problems these assumptions are not sufficiently accurate, and the 
continuous distribution of the components of the system must be consiclercd 
As we shall 8<‘e in Chap 8, this leads to partial rather than ordinary differen¬ 
tial equations 
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( 1 ) 

( 2 ) 

(3) 


(4) 


(5) 


(6) 


In Fig. 5 la we assume the weight to be guided, so that only 
vertical motion, without swinging, is possible As indicated, the 
effect of friction is not neglected. Instead, we suppose that a 
retarding force proportional to the velocity acts at all times. 
Friction of this sort is known as viscous friction or viscous 
damping. Its existence is well established for moderate velocities, 
although for large velocities the resistance may be more nearly 
proportional to the square or even the cube of the velocity 
The analysis of this system is based upon Newton’s law, 

Mass X acceleration = force 

Measuring the displacement y from the equilibrium position of 
the weight, with the jiositive direction upward, we have 

(t^y 

Acceleration of the mass = — 

dr 

The most obvious force acting on the mass is the attraction of 
gravity • 

Gravitational force = —w 

the minus sign indicating that this force acts downward To com¬ 
pute the elastic force, we ob.serve first that a weight w when 
hung on a spring of modulus k, that is, a s])rmg requiring k units 
of force to extend it one unit of length, will stretch the spring a 
distance cciual to w/k Hence, when the weight moves from this 
equilibrium level during the course of its motion, the instantane¬ 
ous elongation of the spring is v^/k — // If this quantity is posi¬ 
tive, the spring is stretched and, therefore, applies to the mass a 
force which acts m the upward, or positive, direction If this 
cjuantity is negative, the spring is compressed and, therefore, 
applies to the mass a fon^e which acts m the dowmward, or nega¬ 
tive, direction The force the spring exerts on the mass at any 
time IS, therefore, 

Force per unit elongation X instantaneous elongation 


or 


Elastic force = k 



w — ky 


To determine the frictional force, we observe that the velocity of 
the mass is dy/dt, hence, from the assumption of viscous damping, 


Frictional force = 



the minus sign indicating that the resistance always acts in 
opposition to the velocity Finally, through some external 
agency, a disturbing force, usually periodic, may act upon the 
system, upsetting its condition of equilibrium We shall consider 
specifically the important case m which 

Impressed force = Fo cos u)l Fo a constant 
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(7) 


(9) 

( 10 ) 
( 11 ) 


(12) 


Substituting from Kqs ( 2 ) to ( 6 ) into Newtonlaw, Kq. (1), 
we thus have 

- 7., = -f {w — ky) — r j- + f 0 ‘“Os co/ 

(j lil^ at 

or 

u' (Py (Jy , , 

— -T r 7 -- -f A '7 = /’ 0 cos a)/ 

y ar dt 

We note from this ecjuation that tlie gravitational force on the 
weight IS canceled by that jiart of tlie ela'xtK' for^ r due to the 
initial ('longation of the spring Because of this, in the future we 
shall neglect gravitational lorces from tle^ outset in the analysis of 
])robleins of this sort 

Fapiation (7) is a typical nonhontogeneous, linear dilferential 
efjuation of the second oidei with constant coelhcients, whose 
general solution we can easilv tnal liy the mettiods of Chap 2 
Ihesuniably it aviII be ai'compaiiK'd by given initial (‘onditions 

;/(0) = (/(> iirid ^7.0 = !>'• 

and, by using th(‘se, tlu^ constants in any complete solution can lie 
deternuneu Howa‘vei, befoir‘ continuing wuth the solution of 
h;(| f7j we shall derive th(‘ eipialions goveinmg t-he other systems 
showni in fig .'>1 

The analysis of the systcun of l'"ig 5 \ }> is bas(‘d upon New'- 
ton's law in torsional form 

Moment of inertia X angular accelciation - torque 

In this case the various torqu<‘s an- 

Klastie torque due to the twisting of the shaft = —kd 

Viscous damping torque “ ^ 

Impressed torque = 7 '0 cos a;/ 

Since the angular acceleration is d^O/dP, on substituting into 
Newton’s law, Eq ( 8 ), we have 

T I a do rp y 

I —— = — A:0 -- c 77 -h i 0 cos (j)t 
dP dt 


or 

/ 7-7 c -rr ko =■- 7 0 cos Oil 
dP dt 

This, too, IS a completely faimhar differential equation, and, 
when accompanied by the initial conditions 


dt r-o 


0 ( 0 ) - 0 , 


and 
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(i:^) 

(14) 


(15) 


(If)) 


(17) 


(1S<0 


it can easily he solved for the function describing the behavior of 
any particular system 

The analysis of the senes, or one-loop, electrical circuit 
shown in Fig 5 1c is based on Kirchhoff’s second law: Tke 
algebraic sum of the potential differences around any closed loop is 
zero, or the voltage impressed on a closed loop is equal to the sum of 
the voltage drops in the rest of the loop Using well-known electrical 
laws, we have 

Voltage diop across the resistance = iR 


Voltage drop across the coiKhmser 



Voltage drop across the inductance = L 


di 

dl 


Thus, assuming the important (ase m which 
lmpress(‘d voltage = U.i cos cji 

on substituting fiom I'^ijs (1.1) to (1(>) iiito Kirc lihofT’s second 
law, we l ave 

L 4“ iR -\- I dt = A'o cos o)/ 


Sliiclly speaking, this is not a dilTerentlal eijuation, but 
lather an ir^egrodifferential equation. Th(‘ operational methods 
we shall dev ('lop m (Miap 7 will handle it diiectly, but, before we 
can a|)])ly tin' technnim*s we have available at this stag(‘, we must 
convert it into a pure' dithn(mtial e(|uati(>n Tlune aie two ways of 
doing this 'Die tiist is to legard not i but. j i dt as the dependent 

variable of th(‘ jirobhun This is not merely a mathematical 
strategeni, for the (juantity 

Q I' I (it 


that is, the mtegiat(d flow of current into the condenser, is ]ire- 
ciselv the (quantity of (dectiicitv, or electric charge, instantane¬ 
ously pTes(*nt on the condenser In terms of Q, then, w^e have the 
eipiation 


<ii'- ^ (It 




fyo cos Ojt 


subject, of course, to the given initial conditions 

0(0) = I dt = Qo and ^ = i(0) = lo 

On the other hand, we can also convert Eep (17) into a differential 
eciuation simply by dififerentiating it w'lth respect to time, getting 
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( 20 ) 

( 21 ) 


( 22 ) 


( 211 ) 


(24a) 


(246) 


The initial conditions required for an equation of this form are 

i(0) = lo and ^1 = lo 

(tt |/«0 

The first of these was given for the original equation The second 
can be found from the original equation, since 

= I 

and the right-hand side is completely known at / = 0 

To establish the differential equation describing the behavior 
of the fiarallel, or one-node-pair, electiical ciicuit shown in Fig 
5 \d, we must use Kirchhoff’s first law: 77/e algebraic tairn of the 
currcjitfi flowing toward anij point in an electrnal circuit is zoo 
Solving for i in Kqs (1,4), (11), and (15) \\(* obtain, respectively, 


Current through the resistance = 


R 


(\iiTent (aiipaiently) thiough the condenser = ( 


,de 

di 


Curient through the inductance - ^ c 


dt 


Idius, a'^.^uming the impoitant case of a cunent source such that 
Impiessed current ^ /o cos co/ 

on substituting fioin Fqs (19) to (22) into KirchhofFs first law, 
w^e have 




OS b)t 


Again, our deruation has led to an integrodifferential equa¬ 
tion To convert it to a pure differential e(|uation we can consider 

j e dt = U, say, as a new' variable, getting 
^ dt^ +« 'di 

subject to initial conditions of the form 


e(0) ^ I' 


e dt -- U 0 


and 


dlj 

dt *“>0 


= Co 


On the other hand, we can simply differentiate Eq. (24) wuth 
respeid to time, getting 

d'^e \ de \ , 

subject to initial conditions of the form 

de I , 

dt l<-o 


e(0) = Co and 


= eo 
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When we collect the differential equations we have derived, 


(7) 


(translational-mechanical) 

(12) 

/ ^ + C ^ + fee = To COR 

(torsional-mechanical) 

(18o) 

r d^Q , jfdQ ,Q p . 1 

1 

> (serie.s-electrical) 

(186) 

1 

(24a) 

^ ft rfT L 7o(-osu( ^ 

^d}e . \ de . e - ( 

1 

> (parallel-electrical) 

(246) 

1 


their essential mathematical identity becomes apjiarent More¬ 
over, we can see the possibility of various physical analogies For 
instance, if we conqiare the translational-mechanical and the 
senes-clectncal systems, we find that 


iv/r 

Mass — < 


‘ inductance L 


Friction c <-► resistance R 


Spring modulus k - 


elastanee ^ 


Impressed force F 
Displacement y ^ 


f imjiressed voltage E [using Eq (18a)] 
dE/dt [using Eq (186)] 
charge Q [using Eq (18a)] 
current i [using Eq (186)] 


and, if we compare the translational-mechanical and the parallel- 
electncal systems, we have the correspondences 


w 

Mass — capacitance C 
Friction c conductance 4 
Spring modulus k susceptance y 

ij 


Impressed foice F 
Displacement y <-► 


I impressed current I [using Eq 
dl/dt [using Eq (246)1 

I j\dt [using Eq. (24a)] 

I voltage e [using Eq. (246)] 


(24fl)] 


We shall not pursue the.se analogies further Instead we shall 
investigate one or two of the systems m detail. 
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1S1 


5.3 

The translational-mechanical system 


(1) 


The displacement y of the weight w in the translational-mechan¬ 
ical system (Fig o la) has been shown t/O satisfy the differential 
equation 


^d'^y . ^ dy 


-f = 


Following the general theory of Chap. 2, it must therefore consist 
of two parts The complementary function, obtained by solving 
Eq (1) when the term representing the impressed force is deleted, 
describes the motion of the weight ii* the absence of any external 
disturbance This intrinsic, oi natural, beliavior of the system is 
called the free motion. The particular integral describes the 
resjioiise of the system to a specific influence external to the 
system The behavior it represents is called the forced motion. 

The nature of the free motion of the system will depend upon 
the roots of the characteristu ecjuation 


w 

- -(- cm -h A. = 0 

Q 


nainclv, 


in 




Akw 

(J 


Since g, w, and k are all positive and c is nonnegative, and since 
the radical, when leal, is certainly less than c, it follows that the 
real [laits of th(‘ loots rni and m-i are always negative We must 
now consider thie(‘ possibilities 


Akw 

9 


> 0 
= 0 
< 0 


In the first case, c^ — Akw/g > 0, there is a relatively large 
amount of friction, and, naturally enough, the system is said to be 
overdamped. The free motion, i e , the motion described by the 
complementary function, is now given by the expression 


y = -h 

where, as we pointed out above, both nii and m^ are negative. 
Thus y a])])roachcs zero as time increases indefinitely This, of 
course, IS perfectly consi.stent with the familiar observation that 
if a system upon which no external foices are acting is displaced 
from its equilibrium position, it will eventually return to that 
position as friction cau.ses the disturbance to subside 
If we set 37 = 0, we obtain the equation 

( w ^ 


-f = 0 


or 


A ^ 0 
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If A and B, which will, of course, be determined by the initial 
conditions of the pioblcm, are of opposite sign, then there is one 
and only one value of / which satishes the last equation On the 
other hand, since a real exiionential furuction must always be 
positive, it follows that when A and B have the same sign or when 
one or the other of them is zero, there is no time wdien // = 0 A 
plot of the displacement y during the free motion of an over- 
damped system must therefore resemble one of the cuives shown 
in I'lg 5 2 or the leflection of one of these cuives in the ^axis 
Figure 5 2rt, h, and c illustrates tlu* possibilities when A and B are 
of oyijiosite sign and y vanishes onct' and only once Assuming 
that the weight starts its motion \\ hen I - 0, the zi'id of y may, of 
course, o(“cur in the physicallv irrelevant int(‘rval — co < / < 0 
Figuie f) 2(i illiistrate's both the case when A and B are of like 
sign and the case when either A oi B is zero and y (‘an never 
vanish 

If = 0 

0 

^ve have the boider-line case m which the roots of the character¬ 
istic equation aie leal and equal 
cy 

rill - m<i - — -- 

Zw 

Wlu'ri this occurs, the motion is said to 1)(‘ critically damped, and 
the exact va^oe of the damping which prodiK'cs it, namely, 

( 2 ) 

IS known as the critical damping. In this case the free motion is 
given by 

y =r + /I/c"*'* 

If wc set // = 0, we olrtain 

A 

Ae^'‘ -f = 0 or / =- 5 B 9 ^ 0 

li 

If B — 0, there is no value of / for which y — 0, but in all otlier 
cases there is one and (rnly one value of I for which y — 0 This 
may be m the physically irrelevant interval — oc < / < 0 , how¬ 
ever, and so it is possible that y wnll not vanish m the actual 
motion even when B 9 ^ 0 (Clearly, there is no essential difference 



(h) (() (d) 

FIGURE 5 2 


Diapluccniont-tinir plots for free overdamprcl an<i critically damped motion 
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(.H) 


(4a) 


(4/>) 

( 4 () 


in the character of the motion in the overdamped and critically 
damped cases, and the possible plots of the displacement y in the 
critically damped case are also represented by the curves of Fig 
5 2 and their reflections in the /-axis 

If — (4kxv/g) < 0, the motion is said to be underdamped. 
The rools of the characteristic equation in this (^ase are the con¬ 
jugate complex numbers 


ry . q hkw , , 

1,7712 — — rr~ ± ^ :7- ^/ - — = — p ± 

I'W Iw \ q 

q [4 
2 w \ 


m 
where 


tq 


2w 


and 


14k IV 
{/ 


The fn'c motion is (lieK'foK* de^'i'iibt'd by 


y = co> 7 / F sin 7 /) 

or eipially well by 
y — Gc^''' cos {qi — II) 
or by 

y = sin ( 7 / — L) 

wheT(‘ \ B, G, II, K, and L are aibitrary constants 

The motion described by eitlu'r (4a), (4/;), or (tc) is known 
as a damped oscillation, and its gi'innal appeaianci' is shovn in 
Fig T) ,4 It IS not periodic, since (li(‘ fai'lor multqilyitig the trigo¬ 
nometric t(*nns IS contmuou.sly decreasing However, lher(‘ are 
regularly spaced pa.ssages tliiough the etiuilihnum position at 
intervals of ir'y In fact, u^-ing the dcsciiption of th(‘ motion jiro- 
vicled by IF] (4h), it is clear that 7 / — 0 whenevei 

cos ( 7 / — II) ~ 0 

that, IS, when yt — H ~ -n 12 4- ^tt 01 



I \ 


FIGURE 5 3 
A tyi)iral di 8 - 
plafeincnt-tiinc 
plot for an 
uiidordaniped 

systorn 



154 


MECHANICAL AND ELECTRICAL CIRCUITS 


CHAP 5 


(5) 


( 6 ) 


CO,/ 

2Tr 


Hence, we can speak of the pseudo period ^ir/q and of the pseudo 
freqmncy or ^‘frequency with damping^^ co^, defined by the equation 


f/ _ 1 g Uicw _ 2 _ ^ 1^9 
27r ‘Itt 2w \ g 27r \ w 


"cycles’Vunit time 


If r = 0, that IS, if there is no damping in the system, the 
motion IS strictly periodic, and its fretpiency, which we shall call 
the undamped natural frequency co„, is, from (5), given by the 
formula 


ci^ _ [kg 
27r 27r \ w 


cycles/unit time 


(Meaily the “frequency’' wlien damping is present is always less 
than the undamped natural frequency The ratio of the two fre¬ 
quencies IS 

torf _ \/kglw — c‘g^l4w'' 

\/ k(j/w 


/l - 

\ 4kw 



sinc(‘, from Kq (2), Ce^ — ‘\kw g Figure 5 t shows a plot of 
to,,/ co„ vcisus r Cc lOvidently, if th(‘ actual dainiiing is only a small 
fiaction ot th(^ critical damping, as it oitcMi is, its etTect upon the 
fuMpu'ticy of the motion is very small Thi^ explains vvliy friction 
IS usually luglected in natural-frequency calculations 


FIGURE 5 4 

Plot Hhowinp; the 
cfTert of fri( tion 
on frequency in 
un underdaniped 
system 



Still using Eq. {4h), it is clear that the extreme values of y 
occur when 

^ = (7 (— pe~^^ cos (qt — //) — qe~^‘ sin (qt — //)] = 0 
that IS, when tan {qt — //) ~ —pfq, or, finally, when 

/ = ''-^-lTan->P + !^=7’ + ^ 
q q q q q 

where T denotes the constant (H/q) — (l/q) Tan~^ (p/q) 

The ratio of successive extreme displacements on the same 
side of the equilibrium position is a quantity of considerable 
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JJn 

yn+2 


(7) 


importance Its value is 


y(T rnr/q) 


y[T {n 2)Tr/q] 


-p[r+(n+2)ir/^l 

COS {qT mr — //) 


Ge-cos + 


COS {qT nir — H -{- ‘Itt) 


f2wp/fl 


Since this result depends only on the parameters of the system 
and not on a\(‘ have thus established the follownn^^ remarkable 
result 


THEOREM 1 

Th( latio of successive maximum bu mmimum') dis))lac(‘inents remains constant 
tliroii^hout tlie entire free motion of an uruh'rdainped system 

If we take the natuial logarithm of lOxpression (7), we haye 

(S', In 

>h ^ 2 q 

d'his (plantity is known as (he logarithmic decrement 5, and it is a 
eonvi'iiient measuie, in nepers per cycle, of the rate at which (ho 
motio dies away * Substituting for p and q from (3) into (8), wo 
find 


j ^ 'pP ^ ^ 2t __ 

<1 ((j/'‘2w) \/(4hv/g) — r'‘ v/cc^ — c* 

Solved for c/Cc, this becomes 


\/ 8 " -f dvr" 

Since yn and yr ,^2 are quantitic'- lelatively ea-.y to measure, 5 can 
easily be comjmled TIkmi fioni JOq (9j the traction of critical 
damping jiresent in a given system can lie found at once 

Now' that w^e have investigated the free motion of the transla¬ 
tional-mechanical system in the overdamjied, critii-ally damped, 
and undcrdamped eases, it lemains for us to consider the forced 
motion To do this we must, of course, find a paiticular integral 
for Eq (1) 

~'iy.+c'^ + ky = F..o.o,t 

g dt^ dl 
Assuming, as usual, 

Y = A cos uii B sm a>/ 


* Equivalently, though leas conventionally, the rate of attenuation could be 
expressed m decibels per cycle by means of the dehnition 

Decibels — 20 log 

I/n+l 
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(10a) 


( 106 ) 


and substituting into (1), collecting terms, and equating to zero 
the coefficients of cos ut and sin ut, we obtain the two conditions 

^/c — w* —^ A ocB = Fq 

— o)cA -h ^/c — cj* 5 = 0 
from which we hnd immediately 

TJ „__ _ p 

[It - u'-iw/g)\^ + («<•)» " 


Hence, 



V{t- 


cj"(ic/(/)] cos cot “h (coc) sin iA)t 
[k — Lj'^{w/g)\^ -h (coc)^ 

Fo Ik — 

- —^ ] -- - cos Lot 

io‘^{w/g)Y -h (wc)2 lv[A' — lo‘^(w/(i)Y + (u3C)“ 

4 , - - _ - si?i col 

\/|A - oi-(wfy)\- + (wr)'^ 


Now, rc'ferring to the triangle shoun in f'lg r> T), it is evident 
that )' can be written m either of the (Hiiiivalent foiins 

5o 

\/\L - o.'iw/g)Y -b (wc)^ 

F, 


Y = 


(cos col cos a 4- sin lot sin a) 


, _ — cos (col — a) 

Vile - i->\w/g)Y 


F, 


\/\k - w“’(w’/f/)P + 

\/[k — Lo‘^(w/g)Y -b (ciJc)* 


^ (cos col siu d 4“ sin cot cos d) 
sin {loI d- d) 


The first of these erjuations is the moU‘ convenient because it 
involves the same function (tlie cosine) as flu* excitation tiTin in 
the differentlal equation Hence, the pfuise ielation betweiMi the 
response of the system and the disturbing force (an easily be 
inferieil Accoidingly, we shall continue with the first ex[)ression 
for ]' 


FIGURE 5.5 

The triangh' 
(icfinmg the 
phase aTl^h'8 
appearing in Kqs. 
(10a) and ( i ()?>), 
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If we divide the numerator and denominator by k and 
rearrange slightly, we obtain 
Fo/k 


Y = 


\/[l — u}'^{w/kg)]^ -f- \uic/kY 
FJk 


cos {ij)i — a) 


V(' - ijs)'+(vi 


_ 2^ Y 

y/kgjw -\/\kw/g) 


cos (oit — a) 




^y[^ — (cuVw„''*)]^ 4- (2(a>/a)„)(c 


T cos {col — a) 


where 6,t = is the static deflection which a constant force of 
magnitude Fo would produce in a spring of modulus k, and, as 
before, cun^ = kg/w and Cr^ = 4kw/g 
The quantity 

~ i2(u,7tr„Hc7f"^ 


is called the magnification ratio. It is the fa(;tor by which the 
static deflection [iroduced in a spring of modulus k by a constant 
force Fo must be multiplied in order to give the amplitudi* of the 
vibrations which lesull when the same force acts d3mainically 
with fieouency a> (hirves of the ruagnihcation ratio M jilotted 
against ii.o frequency ratio co/con for various values of the damping 
ratio c/cr are shown in Fig 5 (> An inspection of Fig 5 (> reveals 
the following interesting facts 

a JIJ = 1, regardless of the amount of damping, if co/con - 0 


FIGURE 5 6 

(\ir\os of the 
intiKinfication 
ratio .1/ as a 
function of the 
iiripressed fre¬ 
quency ratio 

for various 
amounts of 
damping 



fr ^ 
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b If 0 < c/cc < \/\/2, M rises to a maximum as w/wn increases 
from 0, the peak value of M occurring in all cases before the 
impressed frequency u) reaches the undamped natural fre¬ 
quency OJn. 

c The smaller the amount of friction, the larger the maximum of 
M, until for conditions of undamped resonance, namely, 
c/cc = 0 and w = w„, infinite magnification, i.e , a response of 
infinite amplitude, occurs 

d If c/cc ^ l/\/2, the magnification ratio decreases steadily as 
co/aj„ increases from 0. 

e For all values of c/cc, M approaches zero as the impressed fre¬ 
quency IS raised indefinitely above the undamped natural fre¬ 
quency of the system 

The angle a = tan~^ —t-x 0 ^ a ^ t 

k — (i)^{w/g) 

which appears in Eq ( 10 a) and is shown in Fig 5 5, is known as 
the phase angle or angle of lag of the response T^ike the magni¬ 
fication ratio, it, too, can easily be expressed in terms of the 
dimensionless parameters w/co„ and r/Vr To do this we need only 
divide the numerator and denominator of the right-hand side of 
the last expression by k and rearrange slightly 

" 1 "- wHw/kg) 

lati - 

= tan-' 

1 — \U3/0)n) 

It IS important to note that a is not to be read from the prin(‘ipal- 
value branch of the arctangent function, for it is evident from 
Fig 5 5 that sm a is always positive, wheieas cos a can be either 
positive or negative Hence, a must be an angle between 0 and w 
and not an angle m the principal-value range f —tt/ 2 , 7 r/ 2 ). Plots 
of a versus the frequency latio co/con for various values of the 
damping ratio c/cc are shown m I'^ig 5 7 

The physical significance of a is shown in Fig 5 8 The dis¬ 
placement reaches its maxima a/u units of time after or later 
than the driving force reaches its corresponding peak values. 
When the frequency of the disturbing force is well below the 
undamped natural frequency of the system, a is small and the 
forced vibrations lag only slightly behind the driving force When 
the impressed frequency is equal to the natural frequency, the 
response of the system lags the excitation by one-quarter of 
a cycle As cu increases indefinitely, the lag of the response 
approaches half a cycle, or, in other words, the response becomes 
180° out of phase with respect to the driving force 

The results of our detailed study of the vibrating weight can 
now be summarised The complete motion of the system consists 
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FIGURE 5.7 

Curves of the 
phase ariftle a as 
a funrtiori of the 
iiTipress('H fre- 
(piency ratio 
u) wn various 
amounts of 
danipiiif? 



of two arts The first is desiTihod by (h(‘ coniplemcniary func¬ 
tion of (be* underlying differentlal equation and may tie either 
oscillatory or nonoscillatory according as the amount of fnction 
in the system is less (haii or inoic* than the ( ritical dariqiiiig figure 
for the system In any case*, howevei, tins part of tin* solution 
contains factors which decay exjionentially and thus becomes 
vanishingly small in a very short time For this reason it is known 
as the transient. The general expiession for the transient contains 



the phase aoRle 
as a measure of 


the time by 
whieli the 
lesponse lags the 
exeitation in a 
mechanical 
system 


I 1 . .1 . M.*nl 


i 1 (o 17) los (ojl - a) 

a 1 

2Tr I 

1 

u 

U> 1 
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two arbitrary conslarits, which, after the complete solution has 
been constructed, must be determined to fit the initial conditions 
of displacement and velocity The second part of the solution is 
described by the jiarticular integral In the highly important case 
in which the system is acted upon by a pure harmonic disturbing 
force (w(' considt'red only F = Fo cos uit, but without exception 
all our conclusions are equally valid for F = Fo sin Lot), this term 
rcfiresents a harmonic displacement ot the same frequency as the 
excitation but lagging be^hmd the latter 'fhe amplitude of this 
displacement is a definite multiple of the steady deflection which 
would be produeed in the system by a eonstant force of the same 
magnitude as the actual, alternating force This factor of magni¬ 
fication, like the amount of lag, depends solely on the amount of 
friction in the system and on th(‘ ratio of the impressed freciueney 
to the undamped natural frequency of tlu' system The iiarticular 
integral does not decay as time goes on but coiitininss imlefimtely 
in the same pattern f'oi this reason it is known as the steady 
state. 


EXAMPLE 1 

A riO-l)) wejRhl IS suspoTided from a spring of modulus 20 Ib/in When t)ic system is vibrating 
freely, i' observed tliul in coriHeeutivi eyeb's the maximum disfilaeement der reuses by 40 pei 
cent If a force equal to 10 cos wt acts upon the system, find the amplitude of the lesultant 
Hteady-stnte motion if (n'l w ™ (i, (Jn u> = 12, and (r) w = 18 rad/see 

The first sti'p here is to determine the amount of damping presiuit in the system From the 
given data it is clear that 

= 0 00V*. 

Vn 


and, thus, that <5 = In 




Ill — » 0 511 
0.00 


Hence, by Eq (9), 


_5 _ 

V(0 51 1 y + 47r> 


0 OH I 


Next we must compute the undamped natural frequency of the system Using Eq (0), 
we have 

/20 X 384 
50 




12 4 rad/sec 


Knowing c/cr and we can now use Eq (11) to compute the magnification ratio for 
ti) == 0, 12, and 18 Direct substitution gives the values 


A/ 


6 

12 

1 30 

5 94 


18 

0 88 


Fiiiailv, it IS clear that a 10 Ih force, acting statically, will stretch a spring of modulus 
20 Ib/in. n distance 


6.1 - “05 in 




SEC 5 3 


THE TRANSLATIONAL-MECHANICAL SYSTEM 


161 


Honrr, nmltjphing tliin statir’ deflection by the appropriate values of the magniricr.Uon ratio, 
\\c fiuil, for tlic amplitude 1 of the steady-state motion, the i alues 


(i 

12 

0 65 

2 97 


The aniplitude corresponding to the impressed frequency a? = 12 is much larger than eithe” of 
tin others liei niis(‘ this freipieiny ver^ neailv coincides with the natural freepiency of the vs- 
tein, Wn = 12 4 


EXAMPLE 2 

A s\steni (oritaining a lUMdigible amount of damiurig is disturbed Irom its i‘quilihnam position 
|i\ th( suddi'ii application a( t - Oof a forci' (apial to h\, sin i'l Discuss the "ub-ie(|ui n t motion 
of th(‘ s\st(‘m if to IS (lose (o tiie natuial fr('(puMH‘\ m,, 

I’he dilTerc'id ial eiiirititm to be- soI\ <‘d Iu'H' is 

w <1^1/ 

- -- 1 A (/ — /' II sin cot 

q do 


Tlu f ompleuK'nf ary funct ion is, r learly, 

, / k(j I kq 


and it is ca^y to y ('rify th. u finrticuhir integral is 

/'O 

} — -- sin cot 

k Lodti\q) 

Hence, lecallmg that = y/kq'n\ a (omp’ete solution can be wntten 

/'’,// sm li'/ 

1 / = 1 cos cod -k H ^in coj 1 - 

1( iO,d ~ 


0 yvhen t - 0, we must )in\e 1 = 0, leaving 


/ 'iir/ Min cot 

y == H sin co„t -1- ^ 

V' cOn" — 

(iy k\ q CO ( OS (Jit 

?' = - = Huin (OS a - , 

dt y' ‘•Jfi* — ‘‘J 


Since y -- 

(i:d 

and 


Substituting 1 = 0 and t — 0 in the last eijuntion, we obtain 


t) = Jico„ T 


VuilOi 


or li — 


(iOn^ — Co' I 

Hence, substituting into (Id), wc find for the required solution 


UH COri‘‘ — CO^jeOn 


f'\q ( ^ , , A 

- I - am uij -b sin to/ J 

Wicjin^ — Uj 2 ) \ Wn / 


If the impressed frequeney u is very close to the natural frequemy tij„, we inn for descrip¬ 
tive purimses set w/ton I m tlie last expression, obtaining 


FqQ sin iHni — "f 

W’ ti>“ ~ 


y 


CO' 
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If we convert the difference of the sine terms into a product, we get 

/ O) -{- OJn \ ( ^ ~ \ 

2 COS ( —-t I 8in I -- t I 

^ _ \__2 __ \„_2 _/ 

W (u> 4- w„)(to “ a)„) 

If we now 'ienotc the small quantity w - w„ by 2e and note that d + aj„ is approximately equal 
to 2<ji, ran write 

Fog Bin tt 

y — — - --cos u)/ 

w 2cje 

Since c IS a small quantity, the period 2Tr/e of the term sm cf is large Hence, tlie form of the last 
expression sIiowh that y can be regarded as essentially a periodic function cos ml of fiequcncy to, 
with slowly varying amplitude 

F{)g Kin tt 
ti' 2w« 

Figure 5 9 shows the general nature of this behavior when to is nr sil^ but not quite equal to co„ 
and in the limiting case when to = to„ and conditions of pure resonance exist 

This IS one of the simplest illvistrations of (he phenomenon of beats, wduch occurs whenever 
an impressed frequency is dose to a natural frequency of a system oi w'heru'vcr two slightly 
different fr(‘qii(*ncies are impressed upon a system regardless of what its natural frequeiicieH 
may be A v. a^e form of vanaVile amplitude, such as that shown m Fig 5 9a, is said to be ampli¬ 
tude-modulated, and the lightm curves to wduch the actual vvav(‘ penodicnih rises and falls are 
called ita envelope. 


FIGURE 5 9 

Plot illustrating 
the phenomenon 
of beats 
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EXERCISES 

If friHion IS neglected, show that the natural frequency ol a systciri consisting of a mass on 
an elastic susjienBion is approximately 3 cycles/sec, where 5,* is the deflection, in 

inches, produced in the suspension when the mass hangs in static equilibrium 
A heavy motor of unknown weight is set upon a felt mounting pad of unknowm spring 
constant What is the natural frequency of the system if the motor is observed to compress 
the pad ' {c in 

Prove that the logarithm k decrement h is equal to the natural logarithm of the ratio of ny 

nonzero displacement to the displacement one full cych* later 

Show' that the logarithmic decrement 6 can also be computed from the formula 

I , Vn 

6 “ In A =1,2, 3, 

^ yn-^2k 

For a given value of r/t^, determine the minimum nurnbei of cy^'les required to produce a 
redu( (ion of at least .50 per c«*nt in the amplitude of a damped oscdhitiun 
If r/cr IS small, show that the logarithmic decrement i." approximaiely 

5 „ 

Vn Vn 


Show' that the energy dissipated during the nth cvde of a damped oscillation is equal to 
iA/2)(?/„* — ?/nf 2 *) Herife, using the lesiilt of Kxf*reiMe 0, sliow that, when c/cr is small, 
the energy loss during the nth cycle is approximately kyn^b 

If the roots of the elu 'cteristn equation in the oxerdampi'd ease are 7U — —r±s, show 
that in general the complementary function (an hf written ns y = dc"*"' cosh (si -f B) or 
as 7/ = tv Hinh {si -|- D), according as it lias no real zero or one real zero Are there any 
exceptions'? 

If 7/0 and 7’n are, respectively, tin* initial displficerncnl and initial velocity with which an 
'''verdamped system begins its motion, show’ that 


w 

if 



-h r - + A X) 
Vo 


is the condition that the eomplementarv funetion have a real zero 

In addition to the condition of E\t*rci.se 0, wlia( fuither requirrmient is necessary to ensure 
that the zero of the complementary function will be positive, le, w’lll occur during the 
actual motion'? 

An overdainped systi'rn begins to move from its equilibrium position with vcdocity i^o 
Show that its maximum displacement occurs wh( n 


t 


Un 


1 

\/ (c/t,-) 


__ ~ tanh 

^ - 1 



(Hint Use the results of Exercise 8 ) 

In Exercise 11, show that the maximum displacement is 



where a »» Sin ’ — 
c 


18 Investigate the answers to Exercises 11 and 12 in the limit when c/cr approaches 1 (^heck 
your results by working directly with the equation for the transient in the critically damped 
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16 

16 


17 

16 

19 

20 


21 


22 


23 

24 


Show that the maximum difiplarements during tlio free motion of an underdamped fsystem 
do not oecur midway between the zeros of the displacement, hut precede the inid-pointB 
by the constant amount 

Sin"^ (c/ce) 

Invest iRate the motion of a weight hanging on a spring when the disturbing force is equal 
to /'g sin cvt instead of Fo cos ujt In particular, show that Eqs (11) and (12) for the magnifi¬ 
cation ratio and phase angle, respectively, are still the same 

Show that the maxima of the curves of the magnification ratio versus frequency ratio 
occur wdien 



A weight of 128 lb hangs from a spring of modulus 75 Ib/in The damping m the system is 
28 per cent of critical l)eterrnin(‘ the motion of the weight if it is pulled downward 2 in 
from its equilibrium position and suddenly released 

A weight of 96 Ih hangs from a spring of modulus 25 Ih/in The damping in the s\stern is 
60 per rent of t ntical Determine thr* motion of the weight if it is pulled downward 1 m 
from its eiiuilihriurn position and released with an upward veloeitA’ of 2 m /sec 
Polvc P'ivercise 18 if a const ant foue of 50 Ih is suddciiU apjjhcd to the system w hen it is 
at rest in its equilibrium position 

A weight of .i4 lb hangs from a spring of modulus Ib/in During tlie fice motion of the 
8V«' > ui it IS observi d that the maxmiuni displaeemenl of the w'eiglil di'cri'iises to ono-t(Mith 
of its value m five lomplete ryr les of the motion Find the amplitude of thi' steady-stati 
motion piodueed hy a foree equal to 6 sin 15f Ih By whal time interval does this steady- 
state motion lag the driving force? 

A uiiifoini bar of length / and eight w rr^sts on two hoii/ontal rollius wliose axes are parallel 
and whieh rotate inwardly in opjiosition to eiieh other with constant angular velocity 
Friction between tlie liar and eadi roller is asauiiied to lie "dry,” or (Joulornh, that is, it is 
proportional to tlie normal lone between tlu tun and tli(‘ roller, iht' pioportumahty con¬ 
stant being the so-called coefficient of friction n \\ hen Ihe bai, which nlwiiy.s remains m a 
line perpendicular to the axes of ihe rollers, is displaced shghtl> from a symmetrifal pi^si- 
tion, It exc'ciites small osi illations in the horizontal direction DeliMnnne the period of tlus 
motion, and sliow how the value of ^ con thus be found expenmen tally; 

Jn many applications involving forces arising from rotating paits which have become unbal¬ 
anced, the amplitude of the sinusoidal disturtung force acting on a svstem is not constant, 
hut vaiics directly as the square of the frequenev tf a weight suspended from a spring 
is acted iqion t»y a force of this character, determine the* steady-state motion In particular, 
dctermiTK' the form of the magiufjcation ratio and the formula for the angle of lag 
Show that the maxima on the plots of the magnification ratio \ersus tin* frequency ratio 
under the (ondilions of J'jX<‘rcise 22 always occur at values ol the impressed frequi'iiey oj 
greater than (lie natural frequency of the system ton 

A particle of weight w moves in a horizontal line undei the influence of an elastic force 
equal to -- At, wlu're j is the distance of the particle from the origin Friction in the system 
IS assumed to la* dry rather than viscous, that is, it is proportional to the normal force 
hot ween the paiticle and the surfnee on wdiu h it moves, and does not depi’nd on the velocity 
Show that the motion of the system is described by the differential equations 

- j + A-j- ■= when the particle is moving to the left 

P 

w 

— —^w w^hen the particle is moving to the right 
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If tho l>ody starts from rest at the point x “ Jo, find x as a function of t What is the de¬ 
crease in amplitude per c^^cle? When will the body come to rest? 

26 A system is acted upon by two forces 

Fi “ A| sin uit and Ft =* Aj sin wzt 

Friction, though present in the H\stem, is so small that it can be neglected in determining 
the forced motion Discuss the steady-state behavior of the system if w, and ui are nearly 
equal but if neither is close to the natural frequency of the system In particular, show that 
the response consists of a term of frequenc> (wi + a> 2)/2 whose amplitude is modulated by 
a term of fretpieiicy to;, — uii)!'!, and determine the limits between which the amplilude 
varies Hint After the particular integrals have been determined, note that the expression 
K] sin aj|/ -f Ki sin Uit can be written 

K, -\ K, K, - K-, 

—y (sin ojif d- sin utd) + -—— (sin uil sin wjO 

5.4 

The series-electrical circuit 

All the results we obtained in the last section can, after a suitable 
change in terminology, b(‘ a])f)h(*(l to any of the other systems we 
have considered TTowevei, the conceiits central in one field are 
not ah ys of eipial impoitame in I'elated fields, and rt seems 
d(‘sirable to illustrate the minor clifTerences m thi' application of 
oui general lh(‘ory to various classes of systems by considering 
one of the eleetiical cireiiits in some detail 

For the smijih* series eiicuit with an alternating imjiressed 
voltage, we derived (among several ecpiivalent forms) the 
eciuatioii 

( 1 ) = E„u,s^, 

and on comjianng this with tlu* difterential eipiation of the 
vibrating weight 

w cPy , (lu , , ,, 

,,2 + ^ ^ 0 

g (ir di 

we noted tlie (orrespondences 

.Mass ^ inductariec/> 

0 

Friction c < -*■ resistance 

Spring modulus k clastance 

Impressed force F <-> impressed voltage F 
Disjilacemcnt y charge Q 
Velocity V <-► current i 

Extending this correspondence to the derived results by 
making the appropriate substitutions, we infer from the un- 
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( 2 ) 


damped natural frequency of the mechanical system 



that the electrical circuit has a natural frequency 



when no resistance is present Furthermore, the concept of 
critical damping 

kkw 
\ <7 

leads to the concept of critical resistance 



which determines whether the free behavior of the electrical 
system will be oscillatory or nonos( illatory 

The notion of magnificat ion ratio can also be extended to 
the electrieal case, but it is not customary to do so because the 
extension would relate to Q (the analogue of the displacement y), 
whcr<.as in most electrical problems it is not Q but i which is the 
variable of interest To see how a related concept arises in the 
electi u al case, let us convert the jiarticular integral Y given by 
haj (10^), Sec o 3, into its electrical equivalent By direct substi¬ 
tution the result is found to be 


Q = Tan ' C/t,’) - 0 >^L 

Vlil/C) - ‘ wR 

To obtain the curient i, we djff<‘rentiate this, getting 
dQ _ _ Eooj cos {o)t -f- /?) 

or, dividing numerator and denominator by w in the expressions 
for both i and d, 


JjQ COS (^(j}t — d) 

- (T'a;"nj 2 

where 


6 — — d — Tail' 


, coL - (l/coD 

H ' 


From (2) we infer that the steady-state current produced 
by an alternating voltage is of the same frequency as the voltage, 
but differs from it m phase by 

- units of time or ^ cycles 

<ji Itr/Oi ZTT 

Moreover, from Eq (3) it is clear that the numerator of tan 5 
(w'hich IS jiroportiOTial to sm d) can be either positive or negative, 
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whereas the denominator of tan 5 (which is proportional to cos 5) 
IS always positive Hence 5 must be an angle between — 7r/2 and 
7r/2, and so the principal-value designation in Eq (3) is appropri¬ 
ate If b is positive, the steady-state current lags the voltage; if b 
IS negative, the steady-state current leads the voltage 

Furthermore, from Eq (2) we see that the amplitude of the 
steady-state current is obtained by dividing the amplitude of the 
impressed voltage Eq by the expression 

(4) sjlf + (.t - i)’ 

By analogy with Ohm’s law, 1 — E/R, the quantity (4) thus 
ap])ears as a generalized resistance, although it is actually called 
the impedance of the circuit While not the analogue of the 
magnification ratio, the impeilain e is cleaily a similar concept 
Since impedance is dehned a.^ 

Voltage 

Current 

the mechanical quantity corresponding to this is the ratio 

Force 

Velocity 

This IS called tiie mechanical impedance by some wTiters and in 
certain mechanical jirobh'ins has proved a useful notion 

There is another ajipioach to the prolilem of determining the 
steady-state cuirent produced by a harmonic voltage that is well 
worth investigating Sujipose that, given cither E ~ Eq cos uit or 
E — Eo sin (j}t, wo write tlie ba^ic differential er(uation (1) in the 
for ni 

C)) L + R J Q = = /i'oO’os oit + sill 01/) t 

This includes botli jiossibilities foi the voltage, and, if the real 
and the imaginaiy terms retain tfieir identity throughout the 
analysis, then the real pai’t of the parti(‘ular mtegi’al correspond¬ 
ing to will be the jiarticiilar integral for Eq cos o;/, and the 

imaginary part will be the [larticular integral for Eo sm uit 

To see that this is actually the case, we must hrst find a 
particular integral of Eci (3) As usual, we do this by assuming 

Q = 

and substituting into the differential equation This gives 
L( —T T ^ 


t To avoid confusing i = \/ — 1 with i »» current, we shall thremghout the 
rest of this chapter follow the standard practice of writing — 1 ™ j 
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which will be an identity if and only if 
A — 

Ti7n 

Hence Q = + 717 ( 7 ) 

From this, by difTerentiation, we find that 

'N ^ ._ f,.l =__ 

(it juH - U^L + (l/C) R + jWL - [\/wC)\ 


To find the real and imaginary parts of this expression, it is 
ronvcnicnt to use the fart (Scr 14 7) that any complex number 
a -h jh can be written in the form a jh — where the magni¬ 
tude r and the angle S of the complex number are related to the 
components a and h as shown in Fig 5 10 Applied to the denomi¬ 
nator of the second expression for ?, this gives 




where 


6 = Tair 




R 


Hence we can rewrite i in the form 

L -- - y- —I-=- ---- C-'"' 

+ WL - (l/o^Ol^c^^ 

^ —=r - - 

VR^ -h \^L - ' 

_ cos {ojt — 5) -h ; sin (o)t — 6 ) 

~~Vr:^ -WcoCOl'^ 

Comparing this wuth Fqs ( 2 ) and (3), it is clear that the real part 
here is exactly the particular integral corresjionding to Kq cos ojt, 
as we derived it directly Similarly, had we taken the tiouhle to 
w^ork it out explicitly, we would have found for the particular 
integral corresjionding to Fo sm cot precisely the imaginary part 
of the last expression Since it is much easier to find the jiarticular 
integral corresjionding to an exjionential term than it is to find 
the jiarticular integral for a cosine or sine term, the advantage of 
using in jilace of Ko cos cot or Fo sin cot is obvious 


FIGURE 5 10 
Plot showing the 
relations among 
the iTiagnitudr, 
angle, and com¬ 
ponents of a 
general ciMinpJex 
number a -f jh. 
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FIGURE 5.11 

IiripcdfincCH 

ii^'ctrd in HtTK'h 


z, z, 


z 


n 


Xi 


<£> 


The expression 

IS (all('d llie complex impedance Z Tls jnagiiiUid(‘ is tlie (]uanhty 
(* 1 ) wliicli \^ (‘ refeiied lo ''iiniilv as (lu' iinjiedaiiei lls aii^U' 8 is 
tli(' phase shift, ical pail of / is eli arly a r(‘sistaiic(' The* 

iiii.aji;iiiai V pai t of Z called th(‘ reactance. The K'cijooeal of Z is 
railed (he admittance, 'riu* le.U pail o( the adniil (anee is called 1 h(‘ 
conductance, and (In' imai’inaiy jiarl is (‘alhd tlu' susceptance. 

The ino^'t ^tnknip, piop< «t v ot tin* eoinph'X iinp('dane(^ is (hat, 
when any elc'ct rn al ehMneiitaie connect(‘d m seni's oi in paiallel, 
th(‘ coriespondin^i: iinfX'daiM I's ( onihine just as sinijile rivsistaiu ('s 
do Thus t h<‘ st(‘adv-sta1e (urKiit thiou^h a sein\«« o( Z’s (h'j^ 
oil) (an 1)(‘ found hy dividing tin* iin})i('ssed \’olta^;e 1)\' the 
s]nal(‘ 1 in,/CthaiK e 

Z - Z, + /. T T z.. 


or )uiL -f R - 


Siinilaih, the (Uin'iit thioii^h a s(d of (‘lenuMits conni'cti'd in 
jiarallel {I' la o I'J) < an la* found l»\ di\ idnifz; thi' ini))i('--s(‘d \ ollaf^e 
l)V th(' single iinpedaina- Z, (h'lined 1)> tin' K'lation 


1 

Z 


1 

Zi 


f 




Till' nnikc"' it uniKM evs;!! \ (o u^(“ dilTiui'iitlal (‘•piation" in dcdei- 
niinina (fie st( ad if-sfatc Ix’havioi of an efeetmal m'twoik (oi of a 
niecfianical s\st(*ni, il tfu' coinepl ot ni(‘cfianical iinp('danc(‘ is 
used) l''oT tlie tiansitnl hefiavioi, fiowo'Ver, t fus is n<U tiue until 
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the iinpedanre roiicept is generalized through the use of the 
Laplace transforinatjon (Chap 7). 


EXAMPLE 1 


A Honea circuit in which both the rharge and the current are initially zero contains the elements 
L 1, /t: - r = G 2r) X lo ^ if a constant voltage E - 24 is suddenly switched into 

the circuit, hnd the peak value of the resultant current 
The differential equation we must solve is 


d^Q dQ Q 

— 1,000 — + - - 

dP dl G 25 X 10- 


24 


subject to the conditions that f*! = i = 0 when I - 0 The characteristic equation in this case is 


MI* -b l.OOOni + 160,000 - 0 

and its roots an* wh == —200, wn = —Ht)0 Hence, the complementary fun< tion is 

mirx _|_ HDO/ 


To find a particular integral, we assume — 1 and substitute into the differential equation, 
without difficulty getting 


A = 150 X 10 '' 


'rhe complete solution is, therefore, 

Q « , 2oor _|_ "‘’O' -b 150 X 10“" 

and, differentiating, 
dQ 

^ -200r,e Joo' - HOOrif-*'’')' 


Substituting the initial conditions for Q and ? gives the pair of equations 
Cl -b 62 4 150 X 10 * = 0 and Ci 4 4c, - 0 
from which we find at once 


r, = -200 X 10 " cj = 50 X 10 " 

Hence, t == 0.04(c->°'’‘ - e ""O') 

To find the time when i is a maximum, we must equate to z«“ro the time deiivative of i 
0 04(-200e-*""' 4- SOOc-"'’"') = 0 

Dividing out 0 04 X SOOc and transiiosing, we have p*"”"' *= and, taking logarithms, 
i - 0 0024 sec 

The maximum value of i can now be found by substituting tins value of t into the general 
expression for i The result is 

im*, *= 0 019 amp 


EXERCISES 

1 In Example 1 , find the potential difference across each element as a function of time 

2 An ojM'n siTies circuit contains the elements // = 0 01, “ 250, (’ = 10 " At t = 0 , with 

tlie condenser charged to the value Q,, — 10 *, the circuit is closed Find the resultant cur¬ 
rent function of time 

8 Work Exercise 2, given that the circuit elements are L ■* 6 4 X 10 *, * 1 G X 10*, 

C - io-«. 
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4 Work Exercis<‘ 2, ^^ivcn that the circuit eJements are L — 0 01, 7? - J20, T 10“*. 

6 A voltflRe E = 120 cos 1207r^ is suddenly switched into a senes circuit containing the ele¬ 
ments L = I, H = 800, (^ = 4X10 ® What is the resultant steady-state current^ 

6 A series circuit in which C^o = lo == 0 contains the elements L ™ 0 15, R = HfK), 

= 4 X 10“ ® If a constant voltage E “ 26 is suddenly switched into the circuit, find 

the resultant current as a function of time 

7 Work Flxercise 6, given that the circuit cdcnients are L «= 0 16, 7? = 800, !()-« 

8 A series circuit in wlucti (^„ = in = 0 contains the elements L = 1, R = l,OOf), 

f = 4 X 10“® A voltage R = 110 sin CiOirt is suddenly switched into the circuit Find the 
resultant curriuit as a function of tunc 

B A stones circuit in which = lo = 0 contains the elements L = f) 02, R = 250, 

f = 2 X 10 •' A constant voltage E = 28 is suddenly switched into th( circuit Find the 
time it takes foi (lu* jiotential diflercavce across tln‘ (ondeiiser to build up to one-half its 
final value 

10 A condenser (' = 4X10 ^ a resistainc R 250. and an inductance L = 1 are connected 
in parallel A cinient source* (h‘liv(‘ring a constant current / = (Mil is suddenly connecteii 
across the* coininon leiniinals ot the c-leineiits Fiiul the lesultant voltage as a function of 
time 

11 a Frovi' that, if a set of (denu'nts with impedance /i is lonneited in series with a set of 
elements with impedance Z , then the iinjiedarue of the lesultaiit combination is Z\ 4 Zj 
b Frove that, il a set of elemc'nls with unfa dame Z is cminei (I'd m parallel with a set of 
elements with impedanci* Z., then the irnjM'darice Z ot the re.sultant combination is given 
by the formula 

- - - -h - 


12 A constant voltage is suddenly switched info :i rionosc illatorv RL(' circuit in wdiich 
Qo = ?o = t) Show that llu' potential difference ;n loss the < ondenser can nc’ver overshoot 
its final s alue 

13 F'or wdiat vahie(s) of oi is the irnpedanee \/R'^ \ \o>Ij — (l/wt'lpa niimmum? (’onipare 
this wuth the corresponding propeity of the magnification ratio ICxplam 

14 If the frecpiency of the voltage A4 cos u)/ impressed on a sera's ciieuit is the same as the 
natural fre(iuc‘n(‘> ol the circuit, show that tin am|ilitudes of the sti ady-slate potential 
differemea across the mcluetance and the eapaeitame uie each ('cjual to EMJ'IR 

16 Instead of using the ratio R/fir as a diniensionles'' ijaranieter m c ireuit anaU'^is, it is eus- 
tomary to use the so-called quality factor Q (not to be confused with the charge Q) dehned 
as Rc/2R Express the impedanee and the? phase angle for a .simple senes circuit in terms 
of the resistance R, the freciueney ratio 12A2„, and the cjuality fai tor Q 


5.5 

Systems with several degrees of freedom 

The laws of Newton and Kirchhoff, together with the theory of 
simultaneous linear difTercntial etjuations developed in Chap 3 
and the theory of difference equations developed in See 4 5, form 
the basis for the analysis of large classes of systems with more 
than one degree of freedom The details of such applications can 
best be made clear through examples 
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EXAMPLE 1 


Assuming friction to be negligible, find the natural frequencies of the mnss-spring system shown 
in Fig 5.13 


FIGURE 5.13 

A simple masa- 
spring system 




As usual, wc suppose the masses to be guided, by constraints which need not be specified, 
so that they can move only in the vertical direction The instantaneous displacements of the 
masses from their equilibrium positions we shall us<‘ as coordinates to describe the system, dis¬ 
placements above the equilibrium positions being considered positive Since fnction is assumed 
to be negligible, the only forces acting on the masses besides the attraction of gra\ity are thosi' 
transmitted to them by the attached springs Moreover, as we sav in the derivation of Kq (7), 
S<'c 5 2, the foice of gravity (an be neglected provided we also neglect the initial elongation 
of the springs and assume that each is unstretdied when the svstem is m equilibrium 

Noia, when the displacements of tin masses nii and mj are //i and i/i, respectively, the upper 
spring IS changed in length by tin* amount i/i nod the lower spring is changed in length by the 
amount yi — yt Bee ause of these chaiigi^s in length, the springs exert forces ecjual to 

S//, and \[yi - yt) 

respectively Henee, applying Newton’s law to eaeh mass and taking due account of the direc¬ 
tion of th(‘ forces applied to each mass by the attached springs, we have 


d^Vi 

dt^ 


~Hyi ~ 4(yi - i/i) 


o 

dt^ 


4(yi - 


or 


( 1 ) 


(4D2 d- 12)?/, - 4i/, = 0 

-4j/i + (2f>’ + 4)v* - 0 

From these equations we find that the equation satisfied by //, is 
(4/3^ d- 12) -4 

yi « 0 

~4 (21)^ d- 4) 

or (D* d- 5D’ d- 4)7/, =- 0 

The eharactenstic equation of this differential e(|ualion is tv* d- 5 'm* d- 4 = 0, and its roots are 
^ “ ±1, ±27. Hence, 

(2) 7/1 «- Cl cos t d- 1*2 Hin t -f r, eos 21 d~ am 2t 


Since the (i) is homogeneous, it is evident that j /2 aati.sfics the same differential equation 

that j/i Batiifthea Therefore, 


(3) 


Vi “ rfi cos t d- di sin t d- cos 2t d“ ^^4 sin 2t 
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Because we are concerned only with the frequencies at which the system can vibrate, there 
IS no need to determine the relatione which must exist between the c’s and the d’s Whatever 
these relations may be, it is clear that Eqs ( 2 ) and (3) represent periodic displacements at the 
frequencies ui = 1 and ti )2 = 2 Moreover, since Eqs ( 2 ) and (3) (when their cocflicients are 
suitably related) constitute a complete solution of the system ( 1 ) and, hence, a complete descrip¬ 
tion of the possible motion of the given physical system, it follows that free vibrations at fre¬ 
quencies other than toi and wj are impossible 


In the circuit shown m Fig 5 14, find the current m each loop as a function of time, given that 
all rharges and currents arc zero when the switch is closed at f ■» 0 


FIGURE 5.U 

A simple two- 
loop ele( trical 
c ircuit 



volts 


We take as variables the currents ii and ij flowing in the respective loops, noting that the 
current in the rommoii branch is, therefore, ii — 4ppl> mg Kirclihoff’s second law to each 
loop, we obtain the eciuations 

0 5^ -f 200(1, - u) = 50 
at 

300l3 -I- 200(12 - 7,) + “ 0 

or, letting Qi = /12 dt, 

di 1 dQi 

- • -f- 40(h, - 400 ^ =100 

dt (11 

dQ2 

~2ii +5^-1- 200Q2 = 0 

dt 

The characteristic equation of this system is 
(m 400) -400w 

-2 (5m + 200) I 

From Its roots, m, = — 80 and m 2 = — 200 , we can construct the expressions 


= 5 (m* + 280m + 16,000) » 0 


i, — a\e + 6,6 
Q 2 - ajc-"'’* + tne 

which, after the constants a,, 02 , hi, 62 are properly related, will constitute the complementary 
function of the system. 

Substituting these expressions into the second of the two differential equations, we obtain 

-2(^6-""' + 6ie“2oo,^ _j. 5(_80a2e-'"’' - 20062e-»““') + 200(a2C-»'»‘ + fiae"’'’") - 0 

This will be identically true if and only if a, = — 100 a 2 and 6 , — — 4 OO 62 Therefore, the com¬ 
plementary function IS 

r, =- -100o2C-»'»‘ - 40062C"*'»°‘ 

Qi - + 626-*®“ 
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To find a particular integral, we assume ii = and Qi =• A 2 Substituting these into the 
uonhomogeneous system of differential equations, we obtain 

40(M, » 100 

~2Ai + 200yl2 = 0 

Hence, 1 =» and A 2 '^00 

and, therefore, a complete solution of the system is 

i, » -lOOfljc - 400fc2e->»«' + }i 
Q, =. a,c-s»‘ 4- 

Since ii “ 0 and Q 2 = 0 when < ” 0 , we must have 
0 = -lOOoj - 40062 + 

0 “ • di 62 -f- ’ 400 

From these we find without difficulty that 02 = —^^40 H-fid 62 = 3^oo "The required currents 
are, therefore, 

5 2 1 

t, » — g- 80 « _ . p-200t 1 

12 :i 4 

, = 1 g-B0< _ 1 p-aOOl 

d< 3 3 

Evidently « 0 when / “ 0 , as reciuired 

EXAMPLE 3 

Find the rial oral frcqueriMCs of the network shown in Fig o 15 

Hv appl'/iiig KirdihofT’s second law to each loop in turn, \vc obtain the equations 

dji \ f 

1 r dti 1 f 

~ j (i 2 -- U) <ll -t y.f — j (12 - Ja) df = 0 



FIGURE 5 15 

An OHcillatoiy Iadder-t\pe network (As m Fig 4 2, although the network shown appears to 
contain <‘A«rtly He\en loops, the number of loops is actuall> indefinite This is implied by the 
fact that Hie central portion of the figure is drawn with lighter lines, tins convention is used 
throughout the book to suggest a configuration of indefinite extent ) 
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or, introducing new variables via the substitutions 

dQk dtk 


j tk dt =• Qk 
and, rearranging slightly, 


dt 


- DQk 


dt 


d*^ 

dt^ 


- D^Qk 


{LCD^ + l)Qi - Q 2 = 0 
-<?, + (Lr/)* + 2)^2 - 4^3 = 0 


(4) 


— Qk -|- {LCD^ + — Qki2 


+ (LCD^ 4 2)Q„_, - c?„ - 0 
-h (LrD^ 4 2)Q„ - 0 

Since there is no resistance anywhere in the nrtwork, i( is evident that tlie 1 espouse of the 
circuit to any set of nonzero initial conditions of charge and current will b( ])urely oscillatory 
Hence, we assume solutions of the form 

Qk = ak cos cjt 

where oj is the unknown freciuency of the response and the a's arc arbitrary constants Substitut¬ 
ing into the equations of the set (4), diyiding each equation by - cos o)t, and setting 

we obtain the algebraic equations 

— V 1 — n(2)ai 4 U2 =* 0 

flj — (2 — a^)(l2 -b «g *= 0 


(5) a* — (2 — Q;’)a*_,.i + ak +2 ™ 0 

Un 2 - (2 — a*)a„_i 4 rtfi = b 

a„-i - (2 - nr®)On = 0 

In order for these equations to have a nontriyial solution, it is necessary that the deter¬ 
minant of their coetricients be zero However, in this case the determinant of t he coetru lents is of 
the nth order, and to expand it and then solve the rt‘Hultmg nth-degn e equation in ^ 
would be prohibitively time-consuniing Hence it is much lietter to proceed in the following way 
With the exception ot the first and last equations, each equation of the system (5) is of the form 

Oi — (2 — + a*+2 “ d 

In other words, for “ 1, 2, , n — 2, the a's satisfy the linear, constant-coefficient, 

second-order difference equation* 

(0) [E^ - (2 - a^E 4 IW “ 0 

The first and Inst equations, which clenrlv do not fit into the pattern of Ec} f6), nre, of course, 
the two boundary conditions necessary for the determination of the arbitrary constants which 
appear in the complete solution of this difference equation 


* This IB true, of course, onW Vjecause the loops of the network, with the 
exception of the first and the last, are all identical In general, the possibility 
of using difference equations should always be considered in studying sys¬ 
tems, both electrical and mechanical, which consist essentially of a number 
of identical components, identically connected 
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Following the theory of Sec 4 5, the first step in the solution of Eq (6) is to solve its 
characteristic equation 

(7) m2 - (2 - a2)m + 1-0 

gettinR m,,m, - 1 - ^ ± _ 1 

The continuation now involves an investigation of various special oases depending on the possi¬ 
ble values of 1 — (ar*/2) 

First of all, we can immediately reject the possibility that 1 — (ni^/2) ^ 1, for this implies 
that o* ^ 0, which is impossible, since LCu^ is an intrinsically positive quantity Moreover, 

if 1 — (a2/2) — —1, that IS, if «2 — 4, then mi 5= mj = — 1, and so, according to Table 4 2, 
Sec 4 fi, the complete solution of Eq (G) is 

ak “ (ci + C 2 k){ - 1)* 

Imposing the boundary conditions on a*, by substituting a* into the first and last of the equa¬ 
tions (5), we have 

-(-3)l(c, + r,)(-l)l + [(c, 4 2c0(~l)*l -2f, - r, - 0 

l[ci 4 (71 - l)c4(-l)" M - (-2)l(ri t nr,)(- O"! - (“ l)"[r, f {n + 1 )c,l - 0 

Hut Ihese two equations obviously have only the trivial solution Cl Cz *= 0 Heme, 1 — (a*/2) 
cannot equal — 1 

If 1 — (a2/2j < —1, we can write 

Or* 

(8) 1 —- ■» — cosh n n 0 

so that the roots (4 the characteristic equation (7) become 

- cosh n 4 cf‘s’i.2 p ~ 1 = — cosh 4 sinli fx — — e±s 
Hence, a complete solution of (6) can be written 

Ok = Cif —c**)*' b C2( = ( - l)''(di cosh ^lk + r/j binh nk) 

where di =■ Cj 4 Cj and dz — Ci — Cj Again imposing the boundurv conditions on Ok, we have 
— (1 -4 2 cosh fx)(di cosh ^ + dj sinh fx) 4 (d\ cosh 2^ + dj sinh 2/i) = 0 
( — 1)” '(di cosh (n — 1 )m + di Hinh (n ~ 1)^] + ( — 1)" 2 (osh nidi cosh 71^ 4 dj amh nn) = (1 
From these, by collecting terms and then simplifying through the use of the identities 


2 cosh* M “ cosh 2^1 + 1 
2 sin h >1 cosh n — sinh 2^ 

2 cosh 71^ cosh n = cosh (n + 1)^ + cosh (n — 1 )/i 
2 sinh nn cosh n — sinh (ti + 1)^ + sinh (n — 1)^ 

we obtain 


(I + cosh fi)dj + (sinh M)da ” b 
[cosh (n 4- l)M]di + [sinh (n + l)Mlrf 2 = 0 


These eipiations wull have a nontrivial solution if and only if 


1 + cosh /u sinh ^ 

coali (n + 1)^ sinh (n + l)ii 


smh (n + 1)^ + sinh n*i 

2n + J u 

2 smh- - — n cosh “ “ ^ 
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This can vanish only if ^ = 0, which is impoesible, since, from (8 ), m ” 0 implies 1 — (a^/2) — 
— 1, and this possibility has already been considered and rejected Hence the assumption 
1 — faV2) < — 1 also leads only to a trivial solution 

It remains now to consider the possibility — 1 < 1 — (a^/2) < 1 To investigate this case, 
let us put 

Of® 

(9) 1- 2 ™ ^ 0 < /i < IT 

Then the roots of the characteristic equation (7) are 

cos /i ± \/cos* /i — l=co8/i±i sin /i = 
and a complete solution for ojt is 

a* “ Cl cos k/j. -f Cl sin 

Again imposing the boundary conditions on cu, we havi' 

— (2 cos ^ “ l)(ci cos n T cj Kin T (ci cos 2^ + Cj sin 2^) ™ 0 
[cj cos (n — l)/u H Ci sin (n — 1 l/ii) 2 cos , co.s rifi Ci sin n^) = 0 
IToni these, by collecting terms nnd then bimplif3ung thiough the use of the identities 
2 cos* M = 1 4 cos 2/i 
2 sin cos fi =" sin 2^ 

2 cos 71^ ens ^ B= oos (n 4 1 )m T cos (n — 1 )/x 
2 sin nn cos fj. = sin (n 4- 1 )m 4- sin (a - 1 
we obtain fcos ^ - l)r, -\- (sm ^)ci = 0 

[c(/R (v 4- l)/j]ci 4 [sin (n 4- 1 )m]c 2 = 0 

These two equations will ha\o a nontruial solution foi Ci and C2 if and only if 


cos (tj 4' 1 )ii sin (rj 4- 1 


fj. 2n 4“ 1 

= am r?M - Hin (n 1 ))u => —2 am - ooa- n -- 0 


Now sin /i/2 can be zero only if /x is a multiple of 27r, which is impossible in the present case, 
since 0 < /i < tt Hence, we must have 


Therefore, 


2n 4- 1 2iV T 1 


2 N + 1 
2v 4- 1 


N - 0, 1,2, , n - 1 


The values *= 0, 1, ^ tj _ ] jp^d to distinct values of fi which in turn define the n natural 

frequencies of the network, since, from (9), 

\/ LCu^ E? „ = \/2(l — cos (a) = 2 sin ^ 


Hence the required frequencies are given by the formula 


2 /2N 4 1 A 

—7 —^ Sin I-~ - I 

/LC \2n4-l 2/ 


— 0, 1, , n — 1 
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EXERCISES 

1 If Ml — 1, Mj “ 2, A:i - 1, ifc2 - fci “ 2 for the Hystem shown m Fig 5 16, find the natural 
frequencies of the system 


FIGURE 5.16 


2 If Ml "» 1, Mi -= 3, /:i •= 1, Ar2 — /cs “ 3 for the system shown in Fig .5 16, find the natural 
frequencies of the system 

3 If Ml — M2 = 1, /:i “ 1, /ca = 3, ^1 = ^ for the system shown in Fig 5 16, find the natural 
frequencies of the system 

4 Find the displacements of Mi and M as functions of t in Kxercise 1, if the system starts 
from rest with xi = 1 and xa = 0 

6 In the system shown in Fig .5 17 the parameters Mi, A*i, and w are assumed to be known 
Determine ki and Mi so that in the steadv-state forced motion of the system the mass Mi 
will remain at rest 




6 Prove that for no values of the pnratiH ters M 1, M i, ki, ku ki <',in the tw o natural frequencies 
of the system shown m F'lg 5 It» be <‘(|ual 

7 A uniform bur 4 ft long and weighing 16 Ib/ft is supported as shown m Fig 5 IH, on springs 
oi moduli 24 and 15 Ib/in , respectnely If the springs arc guided so that only veitical dis¬ 
placement of the center oi tlu' bar is possible, find the natuial freipicneies of the system 


e 



(a) (b) 


FIGURE 3.18 

(Hint* coordinates, use the displacement 1 / of the center of the bar and the angle of 
rotation y of the bar about its center Assume displacements so small that cos 6 can be 
replaced by 1 and sin 6 can be replaced by $ ) 
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S tn the network shown in Fig 5 It) the current and the charge on the condenser in the closed 
loop are both zero, but the condenser in the open loop bears a charge Qo Find the current 
in each loop as a function of time after the switch is closed 



9 Work Kxercise 8 for the network shown m Fig 5 20 


NGURE 5 20 



4L 


vjjUjps- 


9C 


10 1 .0(1 th( current iii eat h loop of (he network hIiovmi in Fig .5 21 if the switch is closed at an 

instant when nil charges and euirents are zero 


FIGURE 5 21 





IR 


11 Work Kxercise 10 for the network shown in Fig 5 22 


FIGURE 5 22 



12 In Example 3, find the normal modes, i e , the sets of a's for each of the natural frequencies 

13 Work Example 3, with the eonden.ser in series with the inductanci' in the last loop removed 

14 Work Example 3, with the induetanns .and eapaeitanees in each loop interchanged 

16 Kind ihe natural frequencies of the system of n equal mas.ses connected by identical springs 
shown in Fig 5 23 


1 ' 

M 

k 

M 

|-^aTOJr^ 





M k M k g 


figure 5 23 
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16 Find the natural frequencies of the system of n identical disks connected by identical 
lengths of elastic shafting shown in Fig 5 24 



17 Work ICxercise 15, with the spring connecting the right-hand mass to the wall removed. 

18 Work Exercise lb, with the shaft coniici ting the right-hand disk to the wall removed 

19 If a voltage A’o cos ut is inserted in series with the inductance in the first loop of the network 
in Example 3, find expressions for the steady-.state charges on the various condensers if 

2 2 
a 0 < a» <! ——b uj > — 

20 If the capacitances and inductames in the network in Example 3 are interchanged and if a 
voltage E(, cos uil is then inserted in series with the capacitanie in the first loop, find expies- 
sions for the steady-stHte charges on the various condensers if 


1 

a 0 < w < - ._ 

2 \/LC 


b w > — 

2 \/L(' 




Fourier Series 
and 

Integrals 


CHAPTER SIX 


6.1 

» 

introduction In C'haj) 2 we loarncd that nonhoinogCMioous, lineai, ronstant- 
coefficient diflorential e(|iiati()ns cuiitaimnK tninis ol the form 

A cos oj^ and B sin uit 

could easily be solved foi all values of o) Then in (yhap o we dis¬ 
covered that such diffcM’ential equations witc fundamental in the 
study of physical systems subjected to jieriodie disturbances In 
many cases, howevei, tin* forces, tonpies, voltages, or currents 
which act on a system, although peruxlic, aie by no means so 
simple as pure sine and cosine waves bor instance, tin* voltage 
impressi^d on an electrical (ircuit might I’onsist of a senes of pulses 
as shown m Fig G 1«, or the distuibing influence acting on a 
mechanical system might be a force of constant magnitude whose 
direction is periodically and instantaneously reveised, as in 
Fig G 

'Fins raises the (juestion of whether or not a general |)eriodic 





FIGURE 6.1 
Typical periodic 
forcing functions 


t 
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function* can be expressed as a series of sine and cosine terms. 
Specifically, since, for all integral values of n, 

mr(i + 2v) nirt , mrit -f 2p) mrt 

cos- - = cos — and sin - - = sin — 

V V V V 


it IS natural to ask whether an arbitrary function /(<) of period 
2p can be represented by a series of the form 


aot 

2 


irt 27 r/ 

-h Qi cos- V (i 2 cos - -h 

V V 

, , , 1 2 ^^ I 

4" 0 \ Sin — 4" 02 sin — 4“ 


mrl 

4 - an cos-h • • ■ 

V 


mrt 

4- 671 sill-h 


V V P 

If this 16 the case, then the methods of Chap 5, applied to the 
individual terms of such a senes, will enable us, in fact, to analyze 
the behavior of systems acted upon by general periodic disturb¬ 
ances The possibility of such expansions and their delcrmination 
when they exist are the subject matter of Fourier analysis,! to 
which we shall devote this chapter 


6.9 

The Euler coefRcients 


( 1 ) 


To obtain formulas for tin* coelficients a„ and in the expansion 


fin = 


ttI 


27r/ 

4- 

+ (I., 

nwt 



cos 

cos — 

V 


p 



P 


irt 

4- ^2 

2Trt 

4 

■f 

mrt 

4- 


sm 

sm —~ 

V 


P 


P 



assuming, of (‘oiirse, that it exisC, w(‘ shall need the following 
dehmte integials, winch an- \ali(l foi all \ aloes of r/, jirovided m 
and ti are integers satisfying the given icstrictions 


(■ 2 ) 

/'(/ + 2 p mrt 

/ cos (U = 0 

Jd p 

(3) 

rd + 2 p mrt 

/ sm (it = 0 

Jd p 


* A function f{t) is said to lie periodic if there exists a conatant 2p with the 
propert> that 

fit -f 2p) ” fit) for all t 

If 2p iH the biTiallest nuinbei for which this j(lentit\ holds, it is railed the 
period of the function 

t The introduction of the factor ^ 2 « conventional device to render more 

synimeti ical the final formulas for the eoefheients 

X Named for Joseph Fourier (17t>S ISdO), French mathematician and con¬ 
fidant of Napoleon, who first iindiMtook the systematic study of such evpan- 
wions in a mcmorahle monograph, Tln'-oric nnalvtitpie de la chalf^ur,” pub¬ 
lished m 1S22 The use of such scries in partu ular problems, however, dates 
from the time of Daniel Bernoulli (171)0-1762), who used them to solve 
eertain problems connected with vibrating strings 
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rd f 2p 

rmrt 

mrt 

dt 

= 0 



(4) 

L 

cos-cos 

V 

V 

m 

^ n 



fd + 1p 

mrt 

dt 



9^ 0 

(5) 


h 

V 

= V 

n 


fd-h2p 

mirt 

mrt 

dt 

= 0 



((i) 

L 

cos-sm 




Jd 

V 

V 





(V 

rd-\-2p 

rmrt 

mrt 

dt 

= 0 



L 

Riu-sm 


m 

9^ n 

Jd 

V 

V 





(8) 


f d + 2p 

mrt 

dt 





h 

V 

= p 

n 

9^ 0 


With these integrals available, the determination of a„ and bn 
pioeeeds as follows * 

To hnd Go, ^^e assume that tlu* series ( i) can legitimately be 
integrated term by term from t ^ d to f ^ d -j- 2p Then 

Cn\ U fd\'2p fd\^2p irt 

h + ,.os--rff+- 

+ a„ + 

Jd p 

. , fd^2p T^t 

-h hi / sin — dt -f 

Jd p 

rd^ 2 v mrt , 

+ bn / Sin - dt -f 

Jd p 

The integral on the left can always be evaluated, since f(!) is a 
knovMi function which is ass^imed to be integrable At worst, some 
method of approximate integration, such as those we discussed 
111 Sec 4 3, will be required The lirst term on the right is simply 

] d-\ 2p 

^ aol -= pao 

^ d 

By Kq (2), all integrals Avith a co'^ine in the integrand vanish, 
and, by Eq (3), all integrals coiilaming a sine vanish Hence, the 
integrated result reduces to 

fd + 2p 

f(t) dt = pao 
or 

( 9 ) aa = ^ f{l) dt 

To find a„ (n = 1,2, 3, .), we multiply each side of (1) 

by cos mrt Ip and then integrate from d to d -h 2p, assuming 

• Thp procedure here is analogous to the procedure we used in Sec 4 6 to 
express an arbitrary polvnomial as a linear combination of orthogonal poly¬ 
nomials The most obvious difference is that in Sec 4 0 the orthogonality 
condition involved the fiummatwn of products of t^^o different functions 
over a discrete set oi values, but here the orthogonality condition involves 
the integration of products of two different functions 

t A sufficient condition for a aeries of integrable functions to be term-by- 
term integrable is that it be uniformly convergent (Theorem 6, Sec 15 1) 
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again that term-by-term integration is justified. This gives 


k m cos ydt 

1 , 

rd + 2 p 7 nrt ,, 

' cos — dt 

d p 


+ (ll 

rd+2p Trt mrt , 

/ cos — cos — dt -b 

Jd V V 



rd-\-2p mrt 

+ an / cos^ — dt -j- 

Jd p 


+ 6. 

fd-{^2p Trt mrt , 

/ sm -- cos — dt ‘ 

Jd p p 


rd+2p mrt mrt , 

-f- bn / sin — cos — at ■ ■ • 
Jd p p 

Again the integral on the left is conifiletely determined By Eqs. 
(2) and (4), all integrals on the right containing only cosine terms 
vanish except the one involving cos^ mrtfp, which, by Eq (5), is 
equal to p P^inally, by Rq (6), every integral which contains a 
sine IS zero. Hence, 

I f(i) cos - dt = pan 

Jd p 

or 

( 10 ) 

To determine bn, we continue essentially the same procedure 
We multiply (1) by sm iLirt/p and then integrate from d to d -f- 2p, 
getting 

1 rd->r2p nirt 

I f{t) sin - - dt = - flo / >sm - dt 
Jd p 2 Jd p 

fd^2p Trt mrt , 

+ ui / c.os - sin ~ ~ dt ’ 

Jd p p 

fd-\ 2 p mrt mrt . , 

-t ttn / cos — sm — dt + 

Jd p P 

fd^ 2 p ttI mrt . 

-f- fii / sm - sm — d^ + • 

Jd V V 

-f- bn / siir — dt -\r 
Jd p 

As before, every integral on the right vanishes but one, leaving 

/(/) sni2 dt = pbn 

or 

(11) fc„ = i —d/ 

P Jd ^ ^ p 

Formulas (9), (10), and (11) are known as the Euler or 
Euler-Fourier formulas, and the series (1), when its coefficients 
have these values, is known as the Fourier series of f{t) In most 
applications, the interval over which the coefficients are computed 
IS either { — p,p) or (0,2p), so the value of d m the Euler formulas 
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IS usually either — p or 0 Actually, the formula for Oo need not 
be listed, for it can be obtained from the Reiieral expiossion for 
Qn by putting = 0 t It was to achieve this that we wrote the 
constant term as original expansion 

We must be careful at this stage not to delude ourselves with 
the belief that we have proved that, every periodic function/(O 
has a Fourier expansion which converges to it What our analysis 
has showni is mcTcly that, if a function/(/) has an exjiansion of the 
form (!) for which term-by-t(‘rm integiation is valid, then the 
coefTicieiit,s in that series must be given by the luiler formulas 
Questions concmning the conveigeiice of Fouru i senes and, if 
they (‘onverge, the (onditions under which thej^ wnll rej)resent the 
functions wliK'h generated them are many and difficult and are by 
no means com[)lct(‘ly answcriMl yet riii'sc problems are jirimaiily 
of th(‘oretical inl(‘rest, however, foi almost any conceivable prac¬ 
tical a]iplication is coveied tiy the famous theorem of Dirichlet:! 


THEOREM 1 

If Ji/j IS a bonnd(‘d fieiiodic function whieh in any one penod has at most a finite 
rn!ii,f)Ci of local maxima and ininima and a hiiitc niimbci of pomt^ ol discon- 
timiitv, th('n th(' I'ouiier scries of^/(/j convergi's to J{() at all jioints w'heie/(/) is 
continuous and convoiges to the average of t,he right- and left-hand limits of f(() 
at ('acli point vvliere/(/ s discontinuous 

"J'h(* conditions of 'Tlu'orcm 1, winch aic usually K^feiriMl to 
as the Dirichlet conditions, make it ch'ai that a function need not 
be continuous in ordcM' t,o jmsscss a valid Tonner (‘xpansion Fins 
means that a functmn may hav(‘ a giaph consisting of a number 
of disjointed arcs of differi'nt curves, each defined by a differinit 
fonnula, and still be repiesentable liy a ]’\mner senes In using 
the Killer foiniulas to hnd the eoi'tfu'ients in the expansion of 
siieli a function it. wall, therefon^, be ncicssary to bunik up the 
range of integration (d, d F -/F to coi resjiond to the vanous seg¬ 
ments of the fum-tion Thus, in Fig (> 2, the function /(/) is 


FIGURE 6 2 
^ prriodK fnne- 
lioii (1( fined l)y 
dilTcioiit formu¬ 
las over dilTcrcnt 
poitions of a 
period 


fdt) 



t It iH not necessarily the case, however, lhat the value of an m a particular 
problem can be obtained by putting n == 0 in the integrated formula for tt„ 
For instance, in FiXample 2, the integrated formula for a„ is indeterminate 
when n = 0, and evaluation of the indeterminacy yields — d, instead of the 
correct value 3 which is obtained by putting n = 0 before integrating 
X Named for the German mathematician Peter Gustave Lejeune Dirichlet 
(1805-1859) For a proof of this theorem see, for instance, 11 S Carslaw, 

''Fourier Senes,” pp. 225-232, Dover Publications, Inc , New York, 1930. 
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defined by three different expressions fi(0, /aCO, /a(0, on suc¬ 
cessive portions of the period interval d ^ I ^ d -j- 2p Hence it 
IS necessary to write the Euler formulas as 

1 /'d + 2p mrt 

Gn — - f(t) COS- dt 

P Jd p 

1 (r mrt 1 r, rnrt , 1 /■rf+2p ni^i 

= ' L /i(0 ^'os — dt - fiit) COS - - d/ -f- - / f^(i) COS — dt 

P Jd p p Jr p pj» p 

J 1 /■rf+ 2 p mrt 

bu — - / fit) sin — dl 

p Jd p 

^ - L sm--I- - / f 2 (t) sin dt -h - / fait) sin — d< 

P -/d p p Jr p p Jr P 

Incidentally, according to Theorem 1, the Fourier series of the 
function shown in Fig 6.2 will converge to the average values, 
indicated by dots, at the discontinuities at d, r, and d + 2p, 
regardless of the definition (or lack of definition) of the function 
at these points 

example 1 

What I" thp I^ourier expansion of tho periodic function whose definition in one period is 


!(t) - I 


0 

sin 1 


-TT <t <{) 

0 < < < JT 


In this case t)ic half period of the Riven function is p = ir Henci*, taking d = —r in the 
Euler formulas, we liave 


On 


1 fir 

/ fit) cos nt dt 

TT J-r 


a, 

bn 


hi 


sin t cos nl dt 


~ f 0 cos nl dl -{ ^ f 

IT J-r IT Jo 

if 1 / COR (1 — n)t cos (I d n )A 
TT [ 2 \ 1 - r? ^ 1 -f rj /Jo 

1 j cos (tt — nir) 

27r I 1 ~ n 

J / — cos nir — cos rnr 2 \ 

27ryi— n l-|-rJ 1— n^J 


( - -h ^ V 

y 1 — Ti 1 -f n / 


cos riTT + 1 


n \ 


ein t cos t dt 


Bin’ i k 


2x lo 


- r 

ir Jo 

^ fir WO 

- / fit) Bin nidi - / 

IT J — r TT J — T 


0 Bin nl dt -|- 


- r 

IT Jo 


Sin t sin nt dt 


J 1 /sin (1 — n)l sin (1 -I- n)A 

7r 2y 1— n Id-n / o 



n ^ 1 
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Hence, evaluat’iig the eoefhcicntR for n = 0, 1, 2, , we have 


no 


1 sin t 


( eos 2t cos 41 eos 6t cos 8/ 

;! + 15 + ^ 35^ + ' (iF + 


) 


showing the :u eurae\ w ith which the hrst n terms of this senes rejiresent the given funetion 
tue snown in Fig (i foi n = 1, 2, l> Foi n = 4, the grapfis of the paitiiil sums are 

aliimst indistinguishable from tlie giajih ol f{i} 




FIGURE 6 3 
1 h(' t pproMTiiM- 
1 loi] ( I a I iiru t ion 
h\ lh( first few 
( ei ms of its 
I' out lei 
c' p.m'^ion 


1 ' - sin t 



I sin t 2 cu<- 2t 



Inteiesling numeiual senes tan often bt^ obtnmed frtnn Fouru'r seni s bv e\idualing them 
at sja'cifit [loints For instance, il \\v set / = 7r/2 in the abovt' ex[)ansion, we find 


or 



1 1 1 J TT- 

1 3 ~ 3 5 ^ 5 7 7 9 ^ “ 4 


EXAMPLE 2 


l^ind tlie h'ourii'r expansion of the periodit funetion wdiose dehnition in one iieinif' h 


fu) - { 


-3 < f < 0 
0 F ^ < 3 


In this ease the period of the function is 6 Hence p 3, and, from (10) and (11). taking 
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— 3, we have 


1 fO nirt 1 /a nirt 

/ ~t eoH — at + - I t coa — at 
3 J-3 3 3 Jo 3 

1 r 9 nirt 3t nirtlP 1 [ S 

3Ln»7r“ 3 nir 3 J-3 3 [n^ 


9 nirt 3l nirt ^ 

—" coH-^-am — 

3 nir 3 0 


-3 3 

- (1 — cos nir) -f — (cob nir — 1) 

n*ir® nV® 


(coa nir — 1) n 9*^ 0 


fO 1 f 

3 t* 

0 t* 3 

3 

/ ~tdt f 

Idl =- - 

H — =■ 


J-3 ^ 3 Jo 

6 

-3 f) 0 

2 


1 /"O Tint 

— - / — < am — dt -f 

3 J-3 3 

1 r 9 nir 

3[n^ir^ 3 


(3 nirt 

t am — dl 
0 3 


nirt 3/ nirt " 1 9 nirt 31 nirt 

—-cos — + - —^ sm — — — P 08 — 


3 - . .3 

— coa ( — nir)-cos nir ™ 0 

nir nir 


Substituting these coclhcients into the senes (1), we obtain 

3 12/1 irt I 37rt 1 

fit) = --- I ; cos ^ f ^eoa H coa 

2 IT* 


irt I 37rt 1 
COM f - COS - H - coa — -\~ 
39 3 25 3 


EXERCISES 

Determine tfve Fourier expnnaiona of the periodic functions whose df'fuiitiona in one period are 


f 1 0 < i < ir '^ 

^ “ { 0 7r/2 < < < 2ir 

3 fit) ^ sm t/2 ~r < t < JT 

( 2 0 < r < 2ir/3 

1 2ir/3 < I < 4ir/3 

0 4ir/3 < t < 2ir 

7 fit) =• t —IT < f < ir 

0 /(/) “* IT* — —IT < f < ir 

1 0 - 2 < / < - 1 
1 -1 < / < 0 

-1 0 < f < 1 

0 1 < I < 2 

13 fit)^ -.<l<0 

( sm ^ 0 < / < ir 

16 Katablish tlie following numerical results 
1111 
^ 2> 4* ^ 

2* 3* 4* 5* 

1111 
^ 3> 5* ^ 

(Hint [lae the results of Exercise 14 ) 


« ^ f -IT < < < 0 

” 1 f 0 < i < ir 

4 fit) = coa t —ir/2*C.lK ir/'2 

1 0 -3 < / < -1 

1 -I COM irt - 1 < t < 1 
0 1 < t < 3 

8 fit) = c ' 0 < t < 1 

10 fit) = t - - 1 < t < 1 


0 

-2 < t < -1 


( 

-2 < t < - 

1 

-1 < i < 0 


) 1 -t / 

-1 < t < 0 



12 

f tj “ < , 


- 1 

0 < t < 1 


• ^ ) i — t 

0 < t < 1 

0 

1 < t < 2 


\ 

1 < t < 2 

coa t 

-w < t < 0 


^ ^ (0 

-IT < t < 0 



14 

fit) = { , 


Bin t 

0 < t < ir 



0 < t < IT 
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6.3 

Half-range expansions 

When f(t) p)osse.s.ses certain syinnictry properties, the (oefFicients 
in its Fourier e\|)ansion become es|)ecially simjile This was 
illustrated in FiXample 2 of the last section, where the given func¬ 
tion was symmetric in tlie i/-axis and its exiiansion contained 
only cosine terms, i e , only terms which themselves were s in- 
metric m the vertical axis In this section wni shall investigate in 
detail just what effect the symmetry of^(0 has on the coefficients 
in the Founer senes for /(/) 

Sipipose first that f{t) is an even function, i e , sujipose that 
/(-O =/(0 for all t 

or, geometricallv, that the grapli of /(/) is symmetric m the 
v('itical axis 'I'aking d ^ -p in the foimula lor n„, Fit (10), 
Sec () 2, we can w’lite 



Now', in the integral from — p to 0, l(*t us make the substitution 
t = - (it = ~ds 


Then, since t — —p implu's ,s ^ p and t = 0 iinjih(‘s = 0. the 
integial becomes 

(1) - /(_,.) (-,/.) 

But f( — s) — f(.s), Irom the hypothesis that/(0 i^ an even func¬ 
tion ]\Ior(‘over, the cosine is aKo an even function, that is, 

— mrS tLTTii 

cos-= cos -— 

p p 

Finally, the negative sign a^'^cx'iafcd with ds in (1) can be ehmi- 
nat(‘d by changing the limits l)ack to the normal oidcu', 0 to p 
The integral (1) then bec-omes 

- / /(.s) cos cFs 

pj^'’ p 


and thus a„ can be written 



since the two integrals are identical, except for the dummy 
variable of integration, which is immaterial 
Similarly, wx‘ can wTite 
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Again, putting t — —s and dt — —ds 
in the first integral, we find 

hn = -- r f( — s) Sin { — ds) -h i f^/(0 sin ~~ dt 

pjp p p Jo p 

But, by hypothesis, f{ — s) = f{s) 


and 


— mrs nirs 

sin-— sin -- 

P P 


Hence, reversing the limits on the first integral, as before, we 
have 

bn = — - f(s) sin —ds 4- — fit) d/ = 0 

p JO p p JO p 

sihce, except for the irrelevant variable of integration, the two 
integrals an' identical in all but sign Thus we liave established 
the following useful result 


THEOREM 1 

If /(/) IS an even periodic function, then the coefficients m the Fourier senes of 
f{t) are given by the formulas 

„„ = 2 ,,,,^0 

p Jo p 

Now si;,jpose that f(t) is an odd function; i (‘ , suppose that 

f(-t) = -fit) for all I 

or, geometrically, that the graph of f{t) is symmetric in the origin 
Then proceeding just as before, we can write 

1 ^ fp r,.. nirt 

= p p -"" + p i p 

~ ~ ( /(~i) <■<>•'' f - [" JV) cos (It 

pJv p p Jo ' p 

= -/ /(*•) COS — ds 4- - / J{1) cos - dt 

p Jo •’ p p Jo '' p 

= 0 

bn = - f f[t) Sin dt 4 - fit) sin dt 

p J-p p p Jo p 

1 yo V —nirS .1 f p j..,. nirt . 

= - j, /(- s) «»> - p- (- ds) + ~ m s.n — dt 

= 1 P/W su. + i 

P Jo P p Jo p 

p Jo ' p 

Thus we have established the following result 
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theorem 2 

If /(/) IS an odd periodic function, then the coefficients in the Fourier series of f(i) 
are given by the formulas 

Un ^ 0 bn = '- f{t) sin dl 
p Jo p 

It should be emphasized here that oddness end evenness are 
not intrinsic properties of a graph, but depend upon its relation 
to the axes of the coordinate system, hbr instance, in Fig 6 4, if 
the line AA* is chosen as the vertical axis, the graph represents 
an even function whose Fourier expansion, in accordance with 
Theorem 1, will contain only cosine terms On the other hand, if 
BB' IS chosen as the vertical axis, the graph represents an odd 
function, and, by Tlieorcm 2, only sine terms vill appear in its 
expansion Finally, if a general line, such as CC\ is chosen as the 
vertical axis, the grajili represents a function winch is neither odd 
nor even, and both sines and cosines will ajipear in its Fourier 
senes 


FIGURE 6.4 

Plot Hhowin^ how 
oddnc.sa and 
fV(‘nncaH depend 
on the choice of 
axes 

The observations we have just made about the Fourier 
coefficients of odd and even functions serve to reduce by half the 
laboi of exjmnding such functions However, their chief value is 
that they allow us to meet the leijiiiiements of certain jiroblenis* 
m which expansions containing 07iUj cosine terms or expansions 
containing only sine terms must be constructed 

Let us suppose that the conditions of a problem require us to 
consider the values of a function only in the interval from 0 to 
p In other words, conditions of periodicity are iiielevant to the 
problem, and what the function may be outside the range (0,p) is 
completely immaterial This being the case, we can define the 
function m any way we please over the interval (— p,0) and then 
use the Euler formulas to determine the coefficients in the Fourier 
series of its periodic extension Between —p and 0 this series will, 
of course, converge to whatever extension we created over this 
interval, but irrespectwe of this extension the series will represent 
the given function between 0 and p, as required 

In particular, if we extend the function from 0 to —p 



Examples of such problems will be found in Sec 8.4 
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by reflecting it in the vertical axis, so that /( —0 = f(t), the 
original function together with its extension is even; hence, 
the Fourier expansion of its periodic continuation will contain 
only cosine terms [including, of course, the constant term 
ao/2 s: («o/2) cos (Chr^/p)] whose coefficients, as we showed above, 
will be given by 


an 



cos 


mrt 

V 


di 


On the other hand, if we extend the function from 0 to — p by 
reflecting it in the origin, so that /( —0 = —/(0» extended 

function IS odd, and hence the Fourier series of its periodic con¬ 
tinuation will contain only sine terms, whose coefficients will be 
given by 


hn 



mrt 


sin — 
V 


dt 


Thus, simply by imagining the a])propriate extension of a func¬ 
tion originally defined only for 0 < / < p, we can obtain expan¬ 
sions representing the function on this interval and containing 
only cosine terms or only sine terms, as we please Such senes are 
known as half-range expansions. 


EXAMPIE 1 

Find Ibo half-range ovpjinsionH of the function 
fit) ^ t - ()<<<! 

The half-range cosine expansion is obtained by first extending i — from the given interval 
(0,1) to the interval ( — 1,0) by reflection in the v-axis and then taking the function thus defined 
from — I to 1 08 one period of a periodn function of period 2p = 2 Howi'ver, onci* we under¬ 
stand the reasoning underlying the procedure we need give no thought to the extension but can 
write immediately, on the basis of Theorem 1, 


and 


hn 

2 


1 0 

1 

it 


a. = " f ‘ 

1 Jo 

[ I cos m 

L \ 


^ mrt 

1*) cos — dt 


mrt t 

“1-sm mrt 

mr 




cos mr — 


1 2 cos nir\ 

) 


cos mrt 


2 

— - sm mrt H-sin rurt 


)]; 


2(1-1- cos mr) 


n 0 


Hence it is possible to represent/(<) 
(2) fit) 


2 ri r1 

\ jo^ [2 3J0 3 

represent/(O =* 

1 4 / cos ; 

” 6 “ \~i 


< — for 0 < 1 < 1 by the senes 


2ir< cos 4irl cos 6x1 COS Hiri 

+ -T:r- + —:::r- + -r:— + 


36 


64 
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Similarly, the half-range sine expansion is obtained by first extending the given function I — 
to the interval ( —1,0) by reflection in the origin and then extending periodically the function 
thus defined over ( — 1,1) However, all we need to obtain the expansion is to note that, according 
to Theorem 2, 


and 


2 ri nirt 

- I (t — l^) sin — dt 

1 Jo ^ 1 

r /1 t \ (2t 

2 I -sin nirt -cos nirt ] — I - 

riT J 

K cob riTrX /2fcos nir — [) cos I 
n7r~) \ n V \ 


2 

sin nirt -|-cos nirt -cos nirt 

72 V® nir 


4(1— cos 2l7r) 


)]; 


Hence it IS also possible to represent/(f) for 0 < / < I by the senoR 

(3) 


8 /si 


. /sin irt sin IM sin Tiirf sin 7-n( 


Senes (2) and (.1) are b\ no means the onlv Fourier senes that \mII represent t — on the 
inter\nl (0,)) They are riierelv the most convcuiient or most iisetul ones In fact, with every 
jiossible e\t(Mision o[ t — f'om 0 to - I there is associated a senes yielding t — for ()</<!, 
For inst.iTiee, a third such senes might be obtained bv letting tlu' extension be simply the func¬ 
tion defined by t - itself for --1 In this case 


1 /■! nrt 

fln = - y ^ (f — ^2) (;os — dt 

K cos nwt t X / 

H— sin nirt I - (- 

nV2 nir ) yn^TT® 


2 t^ 

- cos lint — — sin nrt 4- " sin nirt 

“ " nV’ rin 




4 cos 72 TT 

71V® 


72 0 


«o “ i 


_ 2 
2 ~ 3 J-i 3 


1 /■! nn 

= - I (t — t^) Sin — 

1 ;-i 1 


nnt 

- dt 


r( ’ 


sin TiTii — - cos nirt ) — 

72 TT 


)-(I. 


2 t^ 

sin 727r< -F -COB nirt — — cos nirt 

72*7r® nir 


)l. 


2 cos nir 
nir 

Hence, for 0 < < < 1 it is also possible to write 
(O f(t) 


1 4 /cos nt COS 2Tr/ 

-3+7.h--4 - + 

2 / am nt 

n(-r- 


cos 37r< cos 4ir< 


9 16 / 

sin 27rf sin 3irf sin 47rf 
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FIGURE 6.5 

Plot BhowiiiK dif- 
ferrnt yx*rioHir 
fuTirtioiKs c'oin- 
c'ldiiiK ov(‘r tlif' 
jntervul (0, J) 


( 6 ) 


(c) 



Figure f) 5a, b, and < shown the extended penodie funetions lepreyented, respeetively, by the 
HerioH (1!), (3), and (A) 

Fipuro () 5 and the associated expansions illustrate another 
intorestinj»: and important fact In Fi^. b the Rraph as a whole 
]s not continuous but has jumps at / 4 J, J d, ±o, In 

the coi 1 (‘spoiidiny^ sen(‘s (4j, the < oellK'U'iit-s (ol the sme terms) 
decrease only at a rate proportional to i/n On the other hand, 
the ^niph m Fi^ (> Tia is evel\y^^here continuous but has corners, 
or points where the tangent changes diic'ction discontmuously 
In the corresponding sin'ies (2), the (‘oellii'ients all become small 
much more ra]udlv than in (4), m fait, they deciease at a rate 
proportional to !/>/“ Finally, the giai^ih in h4g (J 56 not only is 
continuous but has a continuous tangent, i e , there are no points 
where the tangent change's direction abruptly This smoother 
behavior of the function is redccteil in the coellicients in the cor¬ 
responding senes (d), which m this ease appioach zero at a rate 
proportional to l//r’ These obscivations are summed uj) and 
generalized in the following theorem, which we cite without 
proof * 


THEOREM 3 

As n becomes infinite, the coefficients a„ and bn m the Fourier expansion of a 
periodic function satisfying the Dirichlet conditions always apjiroach zero at least 
as rapidly as c/n, where c is a constant iiidejieudent of a If the function has one 
or moie points of discontinuity, then either or 6„, and m general both, can 
decrease no faster than this In general, if a function/(O and its first k — I deriva¬ 
tives satisfy the Dirichlet conditions and are everywhere continuous, then as n 


• Bee, for instance, H. S Carslaw, “Fourier Senes,” pp 269-271, Dover 
Publications, Inc., New York, 1930. 




SEC 6 3 


HALF-RANGE EXPANSIONS 


195 


beconios infinite the eoefficients and in the Fourier senes of/(/) tend to zero 
at least as rajndly as r/n*+^ If, in addition, the kth dc^rivative of f{t) is not every¬ 
where continuous, then either a„ or hn, and in general both, can tend to zero no 
faster than 

More concisely, though less accurately, this theorem asserts that 
the smoother the function, the faster its Fourier expansion 
converges 

Closely associated with the last result arc the following 
observations, which v/e also state without proof 

THEOREM 4* 

The integral of any periodic function which ‘satisfies the J)iri('hlet conditions can 
bf found by teim-by-terrn integiation of the Founei series of the function 

THEOREM 5t 

If f{l) 1^ a jienodic 1 unction which satis(i<‘s tlu' Diiichlet conditions and is every- 
wheie continuous and if/'(O also satisfi(‘s the Dinclikd comiitions, then wherever 
it exists. f\l) can be found by term-by-teiin diffeientiation of the Fourier series 

of fV) 


EXERCISES 

1 li\ coMsirltTing tlip idertily /(/) — 4 d ' ^^ show tlmt any 

fine lion, (i('firi(‘d for lx, pohito c and ru*gati\ ( \ aim of /, can 1 m* \\ r U fert a,s tlic sum of an 
even funclion and .in odd function 


flbLuiri the half-range sine and cosine expansions of each of the following functiors 


2 

4 

6 


fit) = 1 0 < f < 1 

;(/) = cos I 0 < t < '2-n 



3 

6 

7 


fit) = c‘ 0 < f < 1 
fit) - sin / 0 < t < 2n 



8 Obtain a .senc.s, diflcient fiorn the half-ranm sin(‘ expansion, which vmII represent t — t^ 
foi 0 I ''' [ and \vhosc coeflnnents will dc( naisc a,s 1/n’’ 

9 Is it possibh' to obtain a scries icjircsenting / -- t'* foi 0 < / <" I whose eoelfiiients wnll 
decrease as 1 

10 Find a function wliosi' half-range cosine si'ries will have coefTicienls deeieasing as 1/n^ 
neterinine the expansion 

11 How rapidly will the (oelhcients in the Fourici senes of the periodic fumtion 1/(2 + cos t) 
decrease 

I I 0 < i < a 

t - 1 

a < ^ < 1 and if (i is only slightlv less than 1, discuss the behav- 

u — 1 

0 1 < f < 2 


lor of the ooefricient,s in the half-rangi* cosim* expansion of fit) for small and medium values 
of n as well as for n —♦ « 


* See, for instance, E C Titehmarsh, “Theory of Funetions/’ pp. 419-421, 
Oxfoid Book Companx, Ine , New^ York, 19.39 

t See, for instance, E T Whittaker and CJ N Watson, “Modern Analysis,” 
pp, 168-169, The Macmillan Company, New York, 1943 
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IS V f(t), nngirmlly defined only for 0 < < < p, is extended from p to 2p by reflection in the 
lin<‘ t “ p, show that the half-ranRe sine expansion of the extended function contains no 
terms of tlie form 


flirt 

Hin- n even 

2p 

and show tlmt the coefficients of the terms of the form 
nirt 

sin — n odd 

2p 

are given by the formula 



14 Determiiw' how/f/), originally defined only for 0 < / < p, must be extended from p to 2p 
m order that the half-range cosine expansion of the extended function will contain no terms 
of the form 

nni 

(OS — n even 

2p 

Derive a foniiula for the nonzero coefheient.s 

16 Piove Tlu'on'in d lor th(‘ special ease k ~ 1 Under what conditions can either a„ or 
dt ( n ase faster than i/ii^ (Hint Assuming tliat f'(t) has a single point of discontinuity in 
1 ach [K'nod, applj integration by parts, with f{l) = ii, to tlie mb'grals dehning a„ and J 


6.4 


Alternafive forms of Fourier series 


Thf' ong;irial form of tho Fouiiei series of a function, as derived 
in S(‘c 6 2, can bo converted into seveial other trigonoinetiu 
forms and into one in which iniagnuuy exponentials afipear 
instead of real tiigonoinetnc functions For instance, in the senes 

JU) ^ + ) ( «,. cos -f h„ sin -- ) 

2 V P V / 

we can aiijily to each pair of terms of the same frequency the 
usual procedure for reducing the sum of a sine and a cosine of the 
same angle to a single term 


m = 


«n , V / r . 7“o / nirt , bn mri\ 

= ^ -f ) V (1,,^ + bn^ ( - -eos-h sill - ) 

“ -I- P Vdn'^ + V ) 


If we now define the angles 7 „ and fin fiorn the triangle shown in 
Fig 6 6 and set 

Ao = ^ and An = ^/an^ A- bj 
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FIGURE 6.6 

Th»^ triangle 
defining the 
phase angles 7 ^ 
and 6n for the 
remiltant of the 
tcrnis of fre- 
qiiency Jiir/p in 
a Fourier series 



the last spries ran be written 
mrl 


./(M - 


>i = \ ^ 


, JlTvt 

( O'- < O'- 7 „ -j- -,111 sin 7 , 

y> p 


~ -cl 0 -t- V . l „ eos 

II - 1 

or, equally well, 


(",r - -) 


/(/) = vio + 


Kir! . , 

os ''in 6„ 

P 


= y 1 ( 


II o ^ 

V p ) 


flirt 


•os h„ 


In either of tlM‘s(‘ forms, the ijiiantitv 1 „ -= \/(i,r -f ()n^ is 
the resultant amplitude of the eom|i()n(':i(s of fKupK'ncv inr'p, 
that IS, the amplitude of the //th hiiimonie in the' ('\punsion The 
phase angles 

hr, 


y„ = t.an“^ 


and 


(5„ = tan 


measure the lag or lead of tlu' //th haimoiiK with lefi'rimee to a 
jiure cosine 01 puie sine \\av(‘ of the sjiiin' freqiKMiry 

The eomj)le\ expoiuMitial loim ol a houiier '-('lies is ohtaiiK'd 
hy suhstitutmg the expoiu'nlial (‘(juix alent s of (lie eo'-nu' and sme 
terms into the oiiginal form ol tin senes 


m = 


^"+ J V. 


Collecting terms on tlie various ('xponentials and noting that 
1// = — 7 , we obtain 


no . v ■" d/„ . , Qn T ih,. \ 

^ 2 ^ 1, \ ^ ' '^ 2 ^ ''' ) 


m = q 

If we now define 

do 


" 0=2 


On — ihn 

~ 2 “^ 


On -h ihn 


c, 
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( 2 ) 


the last senes can be written in the more symmetric form 


fit) =- 2 

n = — 00 


Now, when it is used at all, this exponential form is used as a 
basic form m its own ri^ht, i e , it is not obtained by transforma¬ 
tion from the trip:ouometric form, but is constructed directly from 
th(‘ Riven function To do this requires that expiessions be avail¬ 
able for the direct evaluation of tlie coefficients c,, These may 
easily be found from the dehnitions of co, c„, and c._„ For 


Co — 2 


1 fd \^2p 
2p 


^ a„ - ^ 1 r 1 r 

2 2 Ip jd 


fit) cos - dt — i 
V V 


mm dt 


nirt nrirt 

(“OS — — i sin 

V 


(,7r/'\ 

V ) 


dt 




= COS dt -b i 

‘2 \ p Jd P P 


fit) sm — dt 
V 


’kirx'i 

2p Jd 


mrl , 7nrt\ 

cos -f- ? sin -- ] dt 

V P J 


Clearly, whether the index ti is ])Ositive, ncRative, or zero, is 
Rivaai by the one formula 



As usual, d will almost always be eith(‘r - p or 0 

In the comjilex repr(‘sentation defiiH'd by (1) and (2), a 
certain symmetrv b(‘tween the ex]iression> foi a fum lion and for 
its Fourier coefficients is evident In I act tlie expressions 


m - J c„e . . 

= 7^ [” SiOe-"'"” dt 
Zp J - p 

are of essentially the same structure, as the following correlation 
reveals 

t ~ n 

fit) ^ Cn = c(n) 

^niT(/p g—niTTf/p 


00 

I <» 

m ^ m 



) dl 
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This duality is worthy of note, and, as our development proceeds 
to the Fourier integral and the Laplace transform, it will become 
still more striking and fundamental. 


EXAMPLE 1 

Find the complex form of the Fourier senes of the function whose definition m one period is 

f(t) = -1 < / < 1 

Since p =■ 1, we have from (2), taking d =■ —1, 


c», 


in if 1, 

2 7-1 2 [ - (1 -f- 

-2(l+n/7r) 

2(1 -f- niff) 


Now = cos TT f I sin TT - - I, and thus <= ( — I')” IJence 


(I)'* f — c' ' ( — I )"(1 - n^7^) sinh 1 

(1 -|- r?/T) 2 1 -f 

The expansion of f(i) is tlierefoie 


fit) = 




(1 


(- 1 )” - 


— run) sinh 1 

_ _ - ^,ruir< 

1 f n^TT* 


Tins, of couiS(‘, ran he ronvcited intv> (he leal trigonometric form without difficulty, for 
we Imvc, In definition, 


fin 

fn = — 


- jbn 
2 


On |- rbn 


and thus, by adding and subtracting, 

(In = C„ -b r_„ bn = I (( n ~ (' n) 

1’herefore in this inolilein 


-niTr) sinh 1 (--1)"(1 + niTf) si^lM _ (-l)^2sinh 1 

1 b ^ 1 -b n*7r'^ i -b 


} 200 = Cn =“ Sinh 1 
Hence, we can also write 


- ;i 77 r) sinh 1 (- l)"fl + niTr) sinh 1 1 

1 + n^n^ 1 -b nV* J 


(- 1 )" 2nn sinh 1 
1 b nV* 


fit) 


/ COB nt COB 2irf C 
= smh 1 - 2 «nl. 1 j 

/ Sin rt 2 
\1 “ 1 


COB 37rf 
+ 97r* 


— 2n Sinh 1 


Bin 2irf 3 sin Snt 
-h4n* I + 9t* 
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EXERCISES 

What 18 the amplitude of the resultant term of frequoney nir/p in the Fourier senes of the func¬ 
tions whose definitions in one period are the following? Wliat is the phase of eacli of these terms 
relative to cos nnlfp’^ relative to sin nntfp"^ 


1 m 


1 0 < / < 1 

0 1 < t <• 4 


( 1 0 < ^ < 1 

-1 I <t <2 

0 2 < / < 4 


2 fit) 


4 m 


It 0 < < < 1 
jo 1 < f < 2 
/ 1 0 < < < 1 
) 0 1 < f < 2 

) -1 2 < t <3 

\ 0 3 < t < 4 


Find the complex form of the Fourier senes of the pi'nodic functions whose definitions in one 


period are 

5 m = 

I 1 ()<<<! 

jo 1 < f < 2 

6 

m = 1 

f 1 0 < t < 1 

1 -1 1 < t < 2 

7 fit) - 

t 0 < t < 1 

6 

m = 1 

-1 < < < 1 

9 fit) = 
10 fit) - 

cos t ~ir/2 < t < ir/2 [Hint 

sin t 0 < t < ir 

Use th( 

' fact that cos B = + c^'®) ] 


6.5 


Applications Altlioufijli we sliall see of hei uses of I'oiii ler series in later chapters, 
f heir most impoitant application at the jiiesent staple of our work 
IS m the analysis of the behavior of physical systems subjected to 
periodic disturbances 


EXAMPLE I 


If the root-mean-square, or rms, value of a function fit) over an interval (af)) is defined as 


( 1 ) 



express the rms value of a periodic function over one period in tiTms of the coefficients in its 
Fourier expansion 

If fit) is of period 2p, we can write 


m 


Go irt 

-t Oi GOa-1- 

2 p 


nirt 

-f a„ cos-(- 

V 


irt 

-f 6] Sin — 4- 
V 


nirt 

+ bn Bin-1- 

p 


Hence, p{t) will consist exclusively of squared terms of the form 


flTrt nirt 

On* cos* - bn* Sin* - 


and cross-product terms of the form 

nirt mri 

ttoUn cos- Gobn Bin - 

P P 


mirt . nirt 

26nif)n Bin-am — 

P P 


Mirt nirt 

2anan cos- cob — 

P P 


mrt nirt 

2ambn COB-Bin- 

P P 
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As in the original derivation of the h.’uler fonnulaa in Sec fi 2, the integral of every cross-product 
term, taken over one period of the function, is zero Moreover, for the stjuared terms we have 

ao^ fr , floV „ ff* nirt , , fp nwt , , ^ 

/ (it = - a„® / cos* — (It = a,Ap / sin* — dt = bm^p 

4 J-p 2 J~p p J-p p 

Hence, dividing each of the nonzero terms hy the length of the period, 2p, we obtain for the 
required rtns value 

^ I /«“' 1 V 

(2) fit) = a/t' + o > 

rma A/ 4 ? 


Sinci' the <oefh( lents in the complex exponimtial foim of the Fourier senes o' j{t) are related to 
the coeMicients in the real tngonoinetile form by the ecjiiations 


F (1 (21 ran also be written 

CO f(i) I = ,/<■«’ + 2 y r,/„ 

|rm» V 

^ fi = 1 

In jiartKiilar, if i — fit) is an eleetiie current llowmg thiough a resistanee R, the average 
poAcer dissipated is 


“ 1 7i 1 


Deteimme the steady-stati' forced \ibiations of the s\stem shown in Fig 0 7a if the applied 
force IS as shown m Fig 0 7h 

Oui first step must be to obtain the Fourier exfiansion of the driving forti' Since Fit) is 
(liarl^ an odd function of /, no cosine teims tan be jiresi nt, and thus we need only compute 


2 /’i-u nut 


bn = , / 2i 

>2 


>{) Hin (it = St) - 
*2 


COM 2niTt 
2n7r 0 


t) n even 


FIGURE 6 7 

A spring-mass 
system acted 
upon by an 
alternating 
square-wave 
force. 
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Fit) 


■~i 


sin Girt 
sin 2rrt -f -—-}- 


Sin lOirf sin 14irt 
5 + - 7 — + 


PiiK'c wo an* (‘oncornod only witli the steady-state forced motion of thi* syatein, we need deter¬ 
mine only the particular integral corresponding to F(t) Since the equation is linear, this can 
h(‘ (lone very siinplv usin^i; the ideas of S(*c 5 It, foi il is mcessaiy only to apply the projier inap;- 
nituation ratio and phase shift to each (omponent of the driving force and add tlie results 
Pri'paiatory to this, we must determine the static detlections that would he produci'd in the 
systiuii by steady forces haviiiK the rnaRnitudes of lln* various terms of Fit) Thesi' are giv(*n by 


(6,dn 


(HO/riTr) lb _ 4 

100 lb/in 5nir 


n odd 


Then we must cahulate the undamped natural Irequency of the sy^sti'in 


'Idle rest of the work can b(>st be piesent(*d in tabular form 


i i 

i 

1 

i\t = 1 

« = 


1 



( Cl) 


! 1 

il} 



Steady-state term = 

J criii 

d,, 1 



Cr U),i 


1 

w, 


tan ' 

I Svfdf sin iiut — O') 

1 

1 1 


z:^) ' Vr. -J 

1 , _ i:! 


1- ' 





1 1 

1 1 

2rr 




1 

- 1 


1 11 

! 2' 

0 28 sm (27rt - 2°) 


OTT 1 

20 





4 1 

Ott 




2_ 

-- 


() 83 

40° 

0 58 sin (Gtt^ — 40°) 


157r 

20 





4 

1 Ott 







0 hs 

174° 

0 03 sm (IOtt/ - 174°) 


2 for 

20 






1477 




4 



0 2b 

177° 

t) 01 sm (1 47rt - J77°) 


dflTT 

20 

1 

1 

1 

1 




Tigiire f) S shows the stearjy-stfite dispJac (‘iiieiit plotted as a IuikMiou of tmif* 

This i'\ani])le illustrates an exce»*dinglv impoitant but sometimes misunderstood eharac- 
ti'risiic of foie(*d \ibiatioiis If the driving (oree is not a pure sine oi cosine function, its Fourier 
opansion will (ontain teiins of fn'ipieneies abovi* the fundamental, or apparent, fiequeney of 
the e\ei(ation II the fieipieney- of oiu* (*f these terms hapjietis to be close to the natural, or 
r('sonant, freipienev o( the s\stem and it the amount ol Inction in the system is small, the corie- 
sporiding inagnifK at ion ratio will be huge, and it> value mav offset inanv times the smaller 
amjilitude of that luiimonie and make the lesultant term tlie dominant part of the (‘iitire 
ri'sponse It and whiai this happi^ns, the r('sJK>n^e will ajipc'ar to be of a loghi'r frequency tlian 
th(' loiee w'liu'li produces it Phguri* (> S shows this dearly, toi, although tlie force alternates 
onh om (' p('r second, the weight is seen to move up and down thiee times per second 

It IS mten'stmg to note that, although tlie diiviiig foice m this example is discontinuous, 
both the displjiiement and the velocity it produces aie continuous This is suggested by the 


t We must T(‘member that heir the subscript n m o),. stands for natural and 
Is in no wav' conni’cted with the parametei n wliuh ideidihes the gimeral 
term m the Fourier evpansion of F{i) In the next station this will not be the 
( ase, but, taken in context, this dual use of tin* symbol aj„ should cause no 
confusion 
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figure 6.8 

Plot showing a 
rc'spDnse of 
apparent fre¬ 
quency greater 
than that of the 
excitation 
producing it. 


1 ) I ' pi U r In 'U 



plot of the di.splaceiiiept shown in Fig 0 S and confirmed l>v an application of Theorem 'i, 
See 6 In fact, hinee the fri'quency of the nth term in the I'ouiur expansion of the diumg 
force F[t) is — D'Jtt ~ rr, it follows, neglecting all !)ut the highest powei of n, (hat, for a 
suniciently large, the magnification ratio M is arbitral liy i lose to 

1 1 _ 2r) 

ojVwn* ~ ^7r)V(2r7)2 “ 

Therefore, since the static deflection corre.sponding to thi' nth term in the expansion of /' it) is 

_4 _ ^ 

5{2n — l)ir 5mr 

it follows that as n becomes infinite tlie (oefhcient of the nth term m the expansion of the steady- 
state displacement, namely, tends to zeio as l()/7r'n^ Thus, according to 'riieorem 't, 

Sec 6 d, the displacement y{t) and the velocity y{t) are continuous, hut the lu celeration y{t) is 
discontinuous 


EXAMPLE 3 

Find the steady-state current produced in the circuit shown in Fig G ha liy the voltage shown in 
Fig 6% 

Our first step must be to find the Fourier expansion of the voltage Since we plan to use 
the complex impedance, it will be convenient to use the complex exponential form of the Fourier 


figure 6-9 

A series circuit 
driven by a 
Bquare-wave 
voltEige 


250 0 02 2x10 ® 

i/W-'TfWP-1(- 

- © - 

(a) 



(b) 




204 


FOURIER SERIES AND INTEGRALS 


CHAP. 6 


series Hence ^vf‘cornpute 


Ull = \ OOFo - 


^-«-ir</0 006 10 005 

- n/Tr/O 005 |o 


1 - c -- 

= fio — 


A’o jEo 


n even, n ^ 0 


ro 005 

Jo 


Therefore, 


FAD = F„ ^ 


2^.-6l)0iir( j^-200iirt | ^glOOiT/ ,.,600iT 

4 _ — -f - “ 4 - -—— 

OTT TT Z IT .jTT 


Now, in 8ee 5 4 \\v showed tliat the steady-state ciinent produei'd by a vollage of tlie form 
could lie found by dividing the voltage by the coinph'x impedance 


Z((jj) = f J - 

the present piobiem, we have* 

/ H)"\ 

Z(u) - 250 4- / h)02a, - j 


Using the data of the present piobiem, we have* 


20(h/7r n odd 


Z(aj) ^ Zn ^ 250 -f 7 


/ 2.r)Oo\ 


Hence, dividing each term in the expansion of the voltage E(t) b} the valin* of Z foi lh(* corre¬ 
sponding fiequency, we hnd 


/(/) = ^ noddf 


. Cn lh() 1 —iF.o 

Dn = — = —---- - =— ■ -- n odd 

Zn Hit 250 4" i(4n7r — 2,500/rnr) 2507i7r -f 1(4^-271* — 2,500) 

If we desire the leal trigonometra foim ol this expansion, namely, 

I (t) = ' jno 'b a, f os 2007rt -f <73 cos tiOOTrZ -b 4 f>\ «m ZOOtt/ + bs sm OOOttI + 


we have at once 


«n = 4- VUn = — lA’o 


L250n7r -b i(47r»«» - 2,500) 
2‘f:o(47r*n2 - 2.500) 


(250n7r)* -b (47r^n^ - 2,500)^ 


-2507177 + - 2,500) 


hr, = t(D„ - /)_„) = Eo 


2507177 -b 7(4i72n* - 2,500) -250n7r + i(4trhi^ - 2,500) 


(2507177)2 -b (4 t727|2 -- 2,500)2 


t Because of the presence of the condenser, the impedance for the DC com¬ 
ponent, or component of zero frequency, is infinite Hence the term * m 
the expansion of is'CO makes no contribution to the steady-state cunent 
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EXERCISES 

1 In Example 2, discuss the problem of determining the complete motion, transient ns well 
as steady-state 

2 In Example 3, wdiy is the current f (t) continuous when the impressed voltage E{t) is dis- 
contmuous'i' Is the charge, Q(t) continuous? 

3 In Example 2, determine the stead}-state motion if the amount of friction is doubled and 
the spring is changed to one of modulus 120 Ib/in 

4 Determine the steady-state motion of the system show’ii in Eig ti 10 


FIGURE 6.10 



6 Determine the steady-state motion of the system shown m Fig b 11 


FIGURE 6 1 1 




( 6 ) 


6 Determine the steady-state current m the circuit shown in Fig b 12 


FIGURE 6 12 



0 4 

-nppT — I 



100 sin 50xt 
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7 Determine the steady-state current in the circuit shown in Fig 6 13 



m I - V'-S y .4n’ 

' n = l 

n — « n “ « 

9 If fi(l) « ^ and /2(0 “ ^ are two functions of peiiod 'Zp, show 

Ti»_ao n — — <B 

71 “ « 

that the average value of the product/ifOAfO over one period is ^ c„r/_„ 

M «= — « 

10 Jf f(i) IS the periodic function whose definition in one period is 

fit] « \t\ -T < t <ir 

find the solution of each of the following equations satisfying the indicated conditions 

a y" *- 1 / « fit) Vo “ Vo “ h v" + '^y' + “ fit) Vo = Vo = d 

c y*' + 4v - fit) Vo vi, « 0 d y" + == /(/) Vo = Vo “= d 


6.6 

Harmonic analysis 

From time to time m applied work it is necessary to construct the 
Fouriei expansion of a function defined by a table of values 
instead of by an analytie expression Various methods have been 
devised foi doing tins, com])rising collectively the held of har¬ 
monic analysis.* Of these, the simplest and most obvious is the 
evaluation of the integrals in the Euler formulas by means of the 
trapezoidal inle Since this method is cjuite satisfactory for the 
occasional applications confronting tlic average workci and need 
be improved u|)on only for the person who must handle numer¬ 
ical functions regulaily, it is the only method w^e shall discuss. 

Because so many problems in harmonic analysis involve 
functions, such as meteorological oi economic quantities, whose 
period IS either a day or a year, it is customary to assume that 


* For a more detailed discussion of harmonic analysis see, for instance, E T 
Whittaker and G Robinson, “The Calculus of Observations,” pp 260-283, 
Blackie & Son, Ltd., Glasgow, 1937 
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(\) 


( 2 ) 


data are available at inteivals of 3 -^ 2 , V 24 , or sometimes 3^8 of a 
period Accordingly, we shall consider a function f{t) of period 2p 
for which values are available at intervals of 



12 


\ow any function f(t) can be expressed as the sum of an even 
function and an odd function simply by writing 


/to Y' 


= g(t) -h h{t), say, 


since ^(0 is clearly even and h(t) is clearly odd Hence the cosine 
terms 111 the expansion of/(0 are just the terms in the half-range 
cosine expansion of r/(/), and the sine terms in the expansion of 
f{l) are just the terms in the half lange sine expansion of h(t) 
For the even function g{t) we have, as usual, 


n = " / q{t) cos - - (it 
p k ' " p 


or, aj)j)lymg the trajiezoidal rule, with = p/12, 

2 p /(}ii nt nirp 

^ ,,l r2V2’'"' p '* + yp r2 + 

, nir ]]p , Q\2 rnr ] 2p\1 


The cosine factors m the last expression can be evaluated once 
and for all and combined with tfic other mimerical factors, imdud- 
mg the *2 definition of qii), to yield a set of weights by 

which the succ(‘sMve values of the sum j(l) + f{ — t) are to be 
multiplied before they are add(‘d The weights involved m the 
calculation of the first ten o’s aie given m Table G 1 
Similarly, foi h{t) we have 


hn 




mrt 

sin - - (it 
V 


2 

V 


2 r p //lo n 1 / p 

12 \ 2 p p 12 

, , nir 11 p 

+ /l]i sill — 

P 12 


mr 

hi sin + 


-h ^11 sin 


ll/tTT 

12 



71TT I2p\ 
p 12 ) 


The weights required for the evaluation of this exjiression arc 
shown in Table G 2 




xn 

£ 


H 


-f -f + 4- -^ + + + -F 4 f ^ 

‘^. vT «*I‘, si. s^ C' v^ sl^ '-T w vJ:. 
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^5a.!S‘&bOM<S.!^oicnC;iO't>£^> 
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crjcomoajcoajQCico 
oO"^-/)QX!'ooooaoco 
lO ^ lO O lO ori lO O »0 or 
OOOOOOOOOO 

ocoooooooo 


o> oi o o oi o (N rs 

I- O t- t- o r- I- O r~ i- 

cooocooocrco 


c: c: o o o 
I I 


cr -i0f0‘0i-i0'0'^ 

ur, —I Ol OC —^ 

• O t- Cl X' Cl t- IC -f X 

ooc:cc:oc30 


"O c ^ c: *c o X) o 'c Q ' 

'^OCCC^CO — 'OO'^O' 

r^Oco5-cO-''Oc^o 

X' o X O Xj c: /j C X O 

ccoQoeoooo 


:r I- c'-' I- I- I- I- ^ I- O' 

rf ;D Oi ^ 'O iC Oj O 'T 

o X cj '? -H C4 Xj -h O 

X) »0 1^ '■I X I- >c X) 

o C' O O c o c c: C O O 

0 0 0 0 0 0 0-030 


rs, /-.I 3 

1 - t- O I - 1 ^ 

o o o o o 


CO 1*0 CO O “-c ro CO O '■O X CO 

O CO O O O CO O O O *0 o 

Xi C'^ X O X X X o X' X X 

»0 X IC O 'O X' *c c Xi >o 


O ^ ri CO c 1 -H 

-f O I' X I - 'T 

o o o o o o o 

O O O O O o o 


i-i-coi'- 0 '-.'*^oi^xi-r- 

lO O O —I -t ro -t- -H Oi CO >0 

^^X'‘.|0'00'*'1X^-H 

Cl -f »ci t- X X X 1^ ‘O rj 

ooooooooooo 

ooooooooooo 


I I I I I I I I I I I 


II II II II II II II II II 


-C-C-C-C-C-sS-tf-^-sS-sC-iS 








210 


FOURIER SERIES AND INTEGRALS 


CHAP. 6 


EXAMPLE 1 

Find a\ for the periodic function whose definition in one period is 


j/o - -2.0000 

I/i “ — 1 7569 
1/2 - -1 5278 
y. » -1 3125 

7/4 - - 1.1111 


1/6 = —0 9236 
= -0 7500 
V7 “ -0 5903 
7/h = —0 4444 
Vb » -0 3125 


7/10 *= —0 1944 
yu “ —0 0903 

l/„ = 0 0000 

1/13 = 0 0764 

yi4 “ 0 1389 


yu “ 0 1875 
yu “ 0 2222 
y ,7 « 0 2431 
2/i 8 “ 0 2500 
yiB = 0 2431 


yao - 0 2222 
yn - 01875 
yaa = 0 1389 
= 0 0764 
ya4 “ 0 0000 


Interpreting the mid-ordinate yia to be fo in our general discussion and using the weights 
m the column headed n =» 1 in Table 6 1, we find without difficulty 


Term 

Weight 

Product 

0 0000 = 0 0000 

0 08333 ! 

0 00000 

0 0764 - 0 0903 = -0 0139 

0 08049 

-0 09112 

0 1389 - 0 1944 = -0 0555 

0 07217 

-0 00401 

0 1875 - 0 3125 “ -0 1250 

0 05893 

-0 00737 

0 2222 - 0 4444 = -0 2222 

0 04167 

-0 0092ti 

0 2431 - 0 5<)()3 = -0 3472 

0 02157 

-0 00749 

0 2.500 - 0 7500 = -0 5000 

0 00000 

0 00000 

0 2431 - 0 923fi = -0 6805 

-0 02157 

0 01409 

0 2222 - i nil = -0 8SS9 

-0 04167 

0 03704 

0 1875 - 1 3125 = -1 1250 

- 0 05893 

0 06630 

0 1389 - 1 5278 - -1 3889 

-0 07217 

0 10024 

0 0764 - 1 7569 = -1 6805 

-0 08049 

0 13520 

0 0000 - 2 0000 - - 2 0000 

-0 04167 

0 08334 


m = 0 40762 


In this simple illustration, y is arfiially the function t - —1 ^ t S whose expansion 
we obtained in Sec 6 3 The exact value of (i\, as read from Kq (4), Sec 6 3, is 4 / 7 r® = 0 4053, 
so our approximation is m eiror by about ^ ^ of 1 per cent 


EXERCISES 

1 Determine by harmonic analysis the Fourier expansion of the circulai are y = -y/2iri — 

(0 ^ j ^ 27r) through an and (n 

2 The following table gives the cylinder pressure in pounds per .square inch for n certain 
4-cycle internal combustion engine at 30" incicments of the crank angle 6. 


e 

P 

e 

P 

e 

P 

e 

P 

6 

P 

0 

200 

150 

45 

300 

0 

450 

0 

600 

5 

30 

350 

180 

20 

330 

0 

480 

0 

630 

11 

60 

167 

210 

0 

360 

0 

510 

0 

660 

30 

90 

102 

240 

0 

390 

0 

540 

0 

690 

90 

120 

65 

270 

0 

420 

0 

570 

0 

720 

200 


Determine the harmonic analysis of the pressure through or and bt 
3 Tht uoninal maximum and minimum temperatures at New York City on the first and 
fifteenth of each month are given in the following table' 
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Max 

Min 


Max 

Mm 



Max 

Min 

Jan t 

38 

26 

May 1 

63 

48 

Sept 

1 

77 

64 

15 

37 

24 

15 

68 

52 


15 

74 

()U 

Feb 1 

37 

24 

June J 

73 

57 

t)et 

1 

60 

55 

15 

38 

24 

15 

77 

60 


15 

64 

40 

Mar 1 

41 

26 

July 1 

80 

64 

Nov 

1 

57 

n 

15 

45 

30 

15 

82 

66 


15 

51 

37 

Apr 1 

51 

36 

Aug 1 

82 

67 

Dee 

1 

45 

32 

15 

57 

42 

15 

80 

1)7 


15 

41 

20 

NeKh’f'iinp the 

sllRllt 

inegulanties in 

the sjmnng of the 

data. d('t( 

‘1 mine 

t he 

harinonie 


jinalvhis of Uic iTia\inuim t(‘m})('raturt* and of thr rmmnuiin ((‘oipnature 
4 Bv (‘valuHtinn tho roinjjlrx form of tlto Fourier mtm s of f(f) Ht tln’ points / = 0, yr^'in, Jirjni, 
, {2ni — [)ir/in and usin^ Mie fait that i'* -- -1 ''liovv (li-if 

— Inii } ( f f -t r m -f fm -4 Tin, f C f ) 
= 2nii<l„, -f IJa,, -I- (I'.rrv 4 

I']\plain liow this formula can b<* used to deleiniiiu' aj)pro\im!ili Iv (In ( oc'IIh'k n( s ol flu 
rusine tornis in the Founci ('Xfiansion of fit) 

6 Bv evalualinp; t lie eornphx form of the houru'i senes of fit) at tlu jiomts t = ir/'2ri, ,h/‘2jn, 
!')Tr/Ini, , (4ra — \ )Tr/'2rn and nsin^;; (he far! that ’ — «, show that 



= Initi — t ,,n I < ~ \m - < -TM -t f rr. f Im -f ,n, '> 

— 2fHih„, 4“ i>t>m I 

Fxplam how this formula f an }»e used to determine appi ovimati l\ tin (oefhfuuits of (he 
sme terms m the Fourier expansion of f(i) 


6.7 

The Fourier integral as the limit of a Fourier series 

Th(‘ properties of I'outiei seni s wo luive t fuis far developed are 
adetpiate to a(“e(ijiiph'li the expansion of any periodic function 
satisfying; the Dinciilet conditions and, in connection with the 
theory of C'hap n (‘liable us to find the response of nuiiK'rous 
mechanical and (dectrical systems to ^(‘neral penodn distuifi¬ 
ances On the othei hand, m many jirobhmis the iinjirt'ssed forc(‘ 
or voltaji;e is nonpei lodu rather tfian p(‘riodic, a single unrcpc'ated 
jiulse, for instancr iMinctions of tins sort cannot be liandh'd 
diiectly through the use of Fount'r senes, for sucli siTies nec(‘s- 
sanly define only periodic functions However, fiy mv(‘-tigatmg 
the limit (if anv) which is approached by a Founei seru's as th(' 
period of the given function becomes mhmte, a suitable repic- 
sentation for nonjieiiodie functions can perhaps b(‘ obtained \n 
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FIGURE 6.14 

A periodio 
function of 
period 2p =» 4 



(0 


(2fl) 


(26, 


exaniplo is ])robably the best way to introduce the theory of this 
procedure 

Consider, then, the function fp{t) shown in Fig (i 14 in tlie 
limit as j) ^ ^ as suggested by Fig 6 15 I'his function is clearly 
even, and thus its Founei expansion contains only cosine terms, 
1 e ^ 


. /A Gfo , -n-f , 

fpiO =-■ T, + - + ^2 p + 

wlicre 


+ n„ cos 

P 




fiQ — - [ 1 dt 

p Jo 

and 


2 

V 


(i,r 



mrt 
(os - 


V 


dl 


2 sin (nirt/p) 1 _ 2 sm (//7r/p) 
p m/p 0 p m/p 


It \vill helj) us now to understand what haiijiens as p if 




I i, 1 1 ) 




I 'lO 


FIGURE 6 15 

Plot illuhtratlUR the nonperiodic limit of a aoquence of periodic functions whose periods become 
infinite. 
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(3) 


(4) 


we plot the "spectrum" of fp(t ); that is, plot an as a function of the 
frequency 

Wn = — rad/unit time 

V 

for different values of j). Introducing the symbol con m Eq (26), 
we then have 

_ 2 sin cjn 

V Wn 

where successive values of n correspond to values of which 
diffei by the constant amount 

(n -h l)7r rnr TT 

Acj == - - -- - = _ 

P V V 

ITen(“e the values of a„ are simply Ihe ordinates of the curve 

2 sin 60 2 sm co 

y = - - =-Aco 

P CO TT CO 

at successive co-mtervals of ir/j), beginning a1 co = 0 These are 
show'll in Fig G.IG for /> = 2, 4, and 8 

As suggested by Fig G Iti and confirmed by Eq (4), the 


FIGURE 6 16 

Plot illustrating 
tlic boliavior of 
the Founei 
(oetficiente of a 
function as the 
period of the 
function becomes 
infinite 






(n - 1) 


K 


(n == 5) 

\^ = 2) (n-4) 


(n - 7) 


(n - 3) 


p- 2 


(n = 1) 

(n=3) 

(n = 4) (n 8)^ 

(n - - 7) 


p = 4 


n 

(n = l) 



p-8 
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coefficient plots, or spectra, for different values of p differ in only 
two respects 

a In the vertical scale, which is inversely proportional to p (or 
directly proportional to Acj) 

b In the horizontal interval between ordinates, which is also 
inversely proportional to p (or equal to Aw) 

The fact that,'as p —► (or Aw —> 0), the frequencies of the terms 
in (1) become more and more closely spaced and the coefficients 
approach zero suggests that this senes, thought of as a function 
of p, IS actually a sum of infinitesimals whose limit is an integral 
Indeed, this is true of Fourier series m general, as the following 
outline of steps reveals 

If we begin with the complex exponential form of a Fourier 
senes [Eqs (1) and (2), Sec 6 4] 

fpit) = X 

n — — * 

and substitute the second expression for c„ into fp(t), we obtain 



Now, as above, let us denote the frequency of the general term by 
nw 

Un = ~ 

V 

and the difference in frequency between successive terms by 

Aw = - 

V 

Then /^(O can be written 

(5) /,(/) = ^ (/x j Ac 

If we now define 

(6) F(w) = ^ ds 

Eq (5) becomes simply 

fp(o = X 

n — — w 

where w„ is a point (the left-hand end point, in fact) in the nth 
subinterval Aw Under very general conditions, the limit of a sum 


( 7 ) 
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(S) 


( 10 ) 


of the form (7) as Ao) —► 0 is the integral 
j Fico) dcx) 

Hence, since p —> cc nnplies Aw —> 0, it follows that there is good 
reason to believe that as p the noiifieriodic limit of /p(/) can 

be written as the integral 

/(i>)c d.s j dw 

Though our derivation of it has been far from complete,* the 
last result is actually a valid representation of th-. iionpenodic 
limit function /(O, provided that, in every finite interval, f(t) 
satisfies the Jiiiichlet conditions and that the improper integral 

l _\ 1/(01 

exists Under these conditions, the so-called Fourier integral (8) 
gives the value of/(/) at. all points where fit) is continuous and 
gives the average of the right- and left-hand limits of f(t) at all 
points wliere /(/) is discontinuous 

The Fouiier integral can be written in various forms I'or 
instance, we can write Eq (8) as 

fit) = j_, 0(“)<”"'rfo) 
where 

(/(w) = I ^ f(s)rdt> 

iliese two expressions, in which th(‘ syinincMry between/(O and 
its coefficient function g{o3) is unmistakable, constitute what is 
known as a Fourier transform pair.j 1'he coefficient function (/(w) 
IS, of course, completely e(|Uivalent to f(0, since when it is known, 
f(f) is determined through Eq (9) In effect, we thus have two 
different representations of the function of our discussion f{t) in 
the time domain and gM in the fiequency domain In passing, 
we note that elaborate tables of Fourier transform parrs have 
been prepared for engineering use J 



* Tile situation is actually not so simple as we have made it ap|>ear, for from 
(6) it 18 clear that the structure of the function f’(cj) depends on p as well as 
upon oj Hence, as p increases, the function we are evaluatini^ changes, and 
the elementary theory oi tin' definite integral is not strictly applicable 
Moreover, the fact that the summation extends over an infinite range makes 
additional investigation of the limiting process necesaar}" The modifications 
required foi a rigorous justification of our conclusions can be found m more 
advanced texts, such as R V f’hurchill, “Fourier Series and Boundary 
Value Problems/' 2d ed , pp 1 McGiaw-Hill Book Company. New 

Vork, lOfid 

t Sometimes it is more (onvenient to associate the factor J /2ir with the inte¬ 
gral for f(l) instead of with the integral for giu) It is also possible to achieve 
a still more symmetric form by associating the factor \ j with each of 
the integrals 

f (j A. Campbell and U M Foster, “Fourier Integrals for Practical Applica¬ 
tions,” D Van Nostrand Company, Inc , Princeton, N J , 1948 
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If we choose, we can, of course, move the factor into the 
integrand of the inner integral in (8), since it does not involve the 
variable s of that integration This gives 

( 11 ) f(t) = ^ dsdu 


In this, we can replace the exponential by its trigonometric equiv¬ 
alent, getting 

f(t) = ^ — t) — i sin w(s — 0] 


If we break this up into two integrals, we get 

/(O = ^ /_« /_ ~ ^ /- /- 

Now sin Ci3(s — t) is an odd function of oi Hence the second 
integral vanishes because of the co-integral ion from — cc to oo 
This could have been foreseen, of course, since by hypothesis 
f(l) is purely real Thus we obtain the real trigonometric 
representation 

(Tia) f(j) = ~ f{s) cos co(.s — 0 ds dto 

Since the integrand of (12a) is an even function of co, we need 
perfonn the co-integration only between 0 and «, provided we 
multiply the result by 2 This gives us the modified form 

(126) J{t) = f f f{s) cos (j)(s — t) ds do) 

IT JO y-« 

If f(t) is either an odd function or an even function, further 
simplifications are possible. To see this, we first expand the factor 
cos w(3 — i) in the integrand of (12o), getting 

/(O = 2Tr /- • o)i ds do) ^ /-» / 


and then write the inner integrals as the sums of integrals over 
(— oo,0) and ( 0 , 00 ). Then 

f{t) = ^ f{s) cos u)S cos oji ds d(i) 

+ ir I-, /o' /(s) cos ws cos ut ds do) 

f(s) am 0)8 sin o)t ds do) 

4 - ^ / fo 
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(i:^) 


(J4) 


(IT)) 


(14a) 


(15a) 


Next we make the substitution s = —z,ds= —(fz in the integrals 
from — to 0 




f{t) = 2 ^ ( — C4jt ( — dz) 

^ j Jq f(^) 

+ 2 ~ / f{~^) ( — ‘*> 2 ) sin oj^ { — dz) dw 

7 \~ f [ f{^) sm £aj,s’ sin Ci)t ds du) 

Jtt Jo 


Now, if fit) is an even fimetion, so that f{ — z) ~ fiz), the 
first integral m (13) beeomes identical with the st'rond when the 
minus sign attached to dz is used to icvcrse the order of the limits 
on the inner integral. Similaily, the third and fourth integrals 
turn out to be negatives of each other Hence we have simply 

f(t) — ~ J /(s) cos co.s cos co( d.s do) fit) even 


This IS called the Founer cosine integral and is analogous to the 
half-range cosine expansion of a periodic function which is even. 

If '"^0 IS an odd function, so that j{ — z) = —f{z), then the 
first and second integials in (13) cancel each other, and the third 
and fourth combine, giving 

/(O ~ I f /(s) sm co.s sin a;/ds dci^ fit) odd 
TT J-oo jo 


This IS the Fourier sine integral and is the analogue of the half¬ 
range sine expansion of an odd periodic function 

For some purposes it is convenient to have the Fourier 
cosine and sine integral rejiresentations displayed as transform 
pairs Thus we (‘an write (14) in the form 


m = /-■- gioj) cos ojt dco 

(/(“) = [' /(-'*) t-Oh <*>« ds 

TT Jo 


fit) even 


and (15) in the form 
/(<) = /:. gi(jo) sin U3l do) 
gio)) = - I fis) sm o)S ds 

TT Jo 


fit) odd 


Equations (14), (14a), (15), and (15a) can, of course, all be modi¬ 
fied by performing the w-integrations only from 0 to ® and multi¬ 
plying the results by 2. 

To illustrate the Fourier integral representation of a non¬ 
periodic function, let us return to the isolated pulse which we 
considered briefly at the beginning of this section (Fig. 6 15) 
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(16) 


Since this function is clearly even, we can use (14), getting 
m = I cos u)8 COS Oil ds diAj = - j cos oit j 

_ 1 r* cos ujt sin a; 

X oj 

_ 2 r* cos cot sin co 
TT Jo CO 


do 


dco 


where the last step follows because the integrand is an even func¬ 
tion of CO Thus, although it is impoSvSible to find an elementary 
antiderivative for the last integral, we know that, as a definite 
integral, it must equal 1 if Ms between —1 and -hi, must equal 
if / = ±1, and must vanish if t is numerically greater than 1 
In the case of the Fourier-series representation of a periodic 
function it was a matter of some interest to determine how well 
the first few tenns of the expansion represented the function 
(Fig h 3) The corresponding problem in the nonperiodic case is 
to investigate how well the Fourier integral represents a function 
when only the components m the lower part of the (continuous) 
frequency range are taken into account Suppose, therefore, that 
we consider only the frequencies below coo In this case, from (16) 
we have, as an approximation to f{t), the finite integral 


2 


X 


i : 


COS ot sin CO , 

- — do 

CO 


Now cos a sm b = 


sin (fl "h b) — sm (a 




and thus we can write the last integral as 

1 f iio sin co(/-hl) , 1 /‘wo sin cof/ — 1) , 

_ / __ „ . - do - / - - do 

TT JO CO IT Jo CO 

In the first of those terms lei co(/ -hi) — ?/, and in the second let 
o{l — 1) = 1 / Then, for our approximation to /(O, we have 

1 /-wad+i) sin , 1 /■wo(/-i) sin ?/ , 

- / - du — - \ - - du 

n Jo u X Jo V 

Although integrals of this form cannot be expressed in terms 

of elementary functions, they occur often enough in applied 

mathematics to have been named and tabulated Specifically, 

c, . . fy sin u j 

Si (-r) = /- du 

Jo u 

IS known as the sine integral function of x and is tabulated in 
numerous handbooks * Using this notation, the apiproximation to 
fit) can be written 

- Si + 1) - isi a.o(/ - 1) 

X X 


* Sf‘o, for instance, E Jahnkr, F Emde, and F Losch, “Tables of Higher 
Functions," 6tb ed , McGraw-Hill Book Company, New York, 1050 
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FIGURE 6 17 
I’lot showing (he 
jippioMiiiiii ion of 
a liincl ion l)\ its 
f mil K I inti'gial 
I ik(*n only ovor 
fri'ipiciK i( h loss 
Ihiiii tiJu 




h 17 shows this a))|)n>xinialion for a)o — ^1, 8, and lt> rad/ 
unit tinio riivsically s|)(‘ak!iig, llu'so (‘urvc's dtvsi nhe tlio output 
of an ideal low-jiass filter, cutting: off all lnM|ueiicies above wo, 
wlu'ii the iii|)iit sij^nal is an isolated n'ctan^ulai jnilse 

Th(‘ ]‘"ourH'i int(*g:rai ri'iuesent at ion of a non])erio(tic iunction 
can b(' used in essiMinallv I la* same way as Ihc^ I'Ouiier senes 
lepresontafion of a pciiodn tunclion in apjihcations like those we 
considoK'd in Sm (i o I'or instaiKU*, it an (‘lectiical eirciiit is 
acted upon by a nonpcuiodn- voltagt* /(/) whose hounei integ;ral 
re])reseiiTat]on is [k>(is (9) and (10)] 

/(O = f" <7(w)c'"'S/u) wheie (j(u:) d.s 

J-*> ' Jtt J - " 

we can still, for pur)ios(‘s of analysis, think of /’(/) as being the 
sum of an inhnite nuinlxu of coinph^x voltages c"-' fn fact, the 
only distinction bi‘t wa*en tin' p(*nodic and nonperiodic cases is 
that in the lattei the “s|)ectruni” of /(/) ('ontains terms of all 
fiequmicies and the amplitude, or intensitv, of the romjionent of 
any givcm frei^uency u) is infinit(‘simal, namely, 

g{oj) dui 

Now in See Ti 4 we saw that the current produced in a circaiit of 
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iriippclanco ^(co) by a (‘Oirii)lex voltage JS simply 

ZM 

llenre, to tmd the current produced by the iionjieriodic voltage 
fit), we need only divide tin* infinitesimal voltage 

[fy(co) 

corresjHmding to the general friMpiency oi by the value of the 
im}K‘dance Z(u:) at that freipiency and Ihen "add," i c , inlegiat(‘, 
all the mfimtesmial currents thus obtained The result is simply 

HO “ f where r/(co) -= f f(}i)e ds 

y~®Z(cj) ‘ Ztt J - 

and Z(oi) is the impedance of the circuit 

A similar discussion of mechanical sysU'ins acted upon by 
non]ieiiodic foices, using the magnifn'ation uitio and jiliase shift 
[Ects (10) and (11), S(‘c 5 d| instead of the complex impi'dance, 
can be based on Ecj (12a) 


EXERCISES 


1 MMk( an niniilitudc-trcqiicm‘\ plot for p ~ 2, '1, and S foj the [XTiudic function whose 
d'‘finilion in on(‘ period is 


a J< 1 ) 



-p < I < --1 

-\ < t 0 

0 t < I 

1 < I < p 


b 



i I 
- t 


p < t < 1 

- 1 < / < 0 

0 < t < I 

1 <' ( < p 


( 0 - P <: t < -1 

1 - p - 1 < / < J 
0 ! < I < p 


d /(/) 


0 

sin -nt 
0 


p < ^ <; - 1 

I < I < I 

1 < I < /> 


2 Make an ainplitude-frcqueney plot foi p =- 2, ^ 1 , and S lot lh<‘ ppiiodic function vnIiosc 
definition in one period is 



- p < t <0 
0 < I < p 



- p < I < 0 
0 <. I < p 


3 Find the Fourier integral representation of eaeh of tlie folloumg functions 




t < 0 
l > 0 



t < 0 
t > 0 


c fii) 


sin t /’ < TT* 
0 > n* 


d 


/«) = { 


cos t 
0 


P < 7rV4 
P > 7rV4 


e m 


0 - =0 < I < 0 

1 0 < < < 1 

0 1 < I < 00 



P <. 1 
P > 1 


4 Find the Fourier integral representation of the function 


1 0 ™ 00 < / < -1 
-1 -1 < I < 0 

1 0 < f < I 

0 I < I < ® 


m = 
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and cxproiis the integral whieh approximatefi this function for freipiencies between 0 and 
ujo in tiTins of fiine integral functions 
6 Find the Fourier integral representation of the function 

» < « C ~1 

-I < t < 0 

0 < t < 1 

1 < / < ® 

and express the integral which approximates this function for frequencies betw-een 0 and a)o 
in terms of sine integial functcms 
6 Find llie Fourier integial represent at lun of tin' fuiution 

( t < \ 

“jo > 1 


fit) 


0 

1 f- t 
1 - i 
0 


2 r w (2 — o/’) cos cot j dw sin iot sin w 

that / - r/ct) IS u particular integral of the equa- 

TT Jo (2 - 0^2)* 0^2 


7 ^Shov^ 

tinn y" H- 'b/' -(- 2y == fit) 
where 

8 Find a particular integral of the <*qunti(ui y" t <iy' -f t>y = f{t) 


{ 1 

= { 0 


< 1 
> 1 


w here 


/(O = I ; 


< I 
> 1 


9 I'dnd a jinrtieular integral of the e(]u.ition y" -f ay' i tnj = fit) where/(t) is the function 
described in lOxeicise h 

10 Find a j'artieular integral of the equation y" j ni/ -|- hy = fit) where fit) is the function 
descrilied in Ext rcisc h 

11 a Using the Fount'r integral representation (I2tij and the concejits of magnification ratio 
and phase angle, obtain a formula for tlie lesjxmst^ tif a meehnnical sv^tern of one degree 
of freedom to a noniienodie diiving forte 

b Shtiw that the lesjionst* tif an eh etru al ent uit of impetlam e Z(w) to a nonpenodie voltage 

fit) = j ^ d(j} 


can lie written 

/■ * r ( j 

Jit) = 2 (R U } foR ‘t { / «in tot (ito 

Jo [ {Zico)f J 

where (R lt/(w)/Z(uj)} and |t/(tj)/Z(a>) | denote, respectively, the real and the imaginary 
part of the complex expression t/(a»)/Z(a)) 

12 If we call gico) in lOq (1(J) the Fourier transform tif /(O, show that, if the various trans¬ 
forms exist, then 

a The Fourier transform of f/fw T wo) 

b The Fourier transform of/'(U is itoqito) 

c The Fourier transform of j fit) dt is g(o})/iu} 
d The Fourier transform of fiiOfiit) is 




giin)gi{co 


u) du 




QiitJ — v)g 2 (v) dv 


wlicic gi{o}) and gtiu) are, respectively, the F'ouner transforms of fiit) and fiit) 

13 I^et fcO be a function w'hich is identically zero outside the interval (--1,1;, so that the 
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Fourier transform of f(t) is 

r(/) - ^ 


By repeated dilTereniiation of Til), show that 


Tit-) 


TT dcj- 


where S(u)) => (sin u})/ii} Explain how this result can be used to obtain the Fourier trans¬ 
form of a sinj^lc pulse defined between - 1 and 1 by a convergent power senes * 

14 Using the definitions of Exercise 13, show that 

7’(pfiiirr) as S(oJ — Ht) 

IT 


Explain how this result can be used to obtain the Fourier transform of a single pulse 
defined between — 1 and 1 by a Fourier series in either complex exponential or real trigono¬ 
metric form 

16 If fit) IS a pulse defined betw(*en —1 and 1 by either of the equivalent senes 
^ (a« cos nwt + (>n sin nrt) ^ CnC’*’*'' 

n ■■ 0 n = — « 

use the results of Exercise 14 to show that 

an =” 7r(<^(mr) 4 <pi — nir)l 

h„ * lir[<i>imr) — </)( —nTr)] 

Cr» “ 7T0(nir / 

where 0 ( 01 ) is the Fourier transform of the pulse 


6.8 

From the Fourier integral to the Laplace transform 

In many applications of the Fouriei lulegral the function to be 
represented is identically zero bt‘fore some instant, usually t = 0 
When this is the case, the general Fourier (raiisforin pair, given 
by Fqs (9) and (10), Sec 0 7, becomes the unilateral Fourier 
transform pairf 

(1) f(t) = Qio})e'^^ du3 g{io) = ^ /(.s-)e-flfs 

Useful as this is in many applications, it is still inadequate to 


* In particular problems, the book “Tables of the Function and of Its 

First Eleven Derivatives," Harvard University Press, Cambridge, Mass , 
will be of considerable help 

t Note that, for later eouvenience, w'c have chosen to incorporate the factor 
1 /2t m the integral for fit) rather than m the integral for giu), as we did 
earlier 
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FIGURE 6.18 

The unit step 
function u(t) 



FIGURE 6.19 
Plot showmg how 


jii(M 

i 

11- 

I 

1 

—— — 


represent such a .simple function as the so-called unit step fi no¬ 
tion y(t) (Fig (i 18) 


t < 0 
/ > 0 


u(t) = 

In fact, for this function 




1 e~ 


' (is 


f I * 

— io}0 


cos CO.'? — i sin cos I 


and this is completely meaningless, since both the cosine and sine 
oscillate without limit as Ihcur arguments become infinite 

As an artifice to handle this case and others like it, the func¬ 
tion » is sometimes inserted m place of the unit stej) function. 
Now as we shall soon see, has a unilateral Fourier transform 
when a is po.sitiV(‘ Moreover, when a approaches zero, c”“', con- 
.sidered for t > 0, aj)})roaches the unit step function (I’lg b 19) 
Hence, it is natural to hope that the order of the operations of 
letting a a[)proach zero and taking the Fourier transform can be 
interchanged. // this is the case, then we can jiostpone letting 
a 0 until after (he transform has been taken, and all will be well 
In the present problem the development jiroceeds as follows 
Instead of transforming y(t) wo transform 0 "“', getting 


gM = ft 


(is = 


- (a -f- iw) 1 0 


1 _ 

a loj 


since the factor 6'“" now ensures that the aiitideiivative vanishes 



c““‘ (a,t > 0) approaches the unit step function when a approaches zero 
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m = 


at the upper limit Thus, 

m = 2^ 

27r “ a -h 70) ^ ^ 

_ 1 eos o)/ -|- 7 sin w/ a — ?a) ^ 

‘Itt ^ a + 7o) a — io) 

_ 1 (a cos oot H- o) sin cot) -j- i(a sm ojI — oj cos ujl) 


Now, the imaginary part of the integrand, namely, 


a sin u)t — o,' cos cot 


is an odd function of oj and, hence, will vanish wlien integrated 
between the limits — qo and qo On the other hand, the real pait 
of the integrand is an even function of o>, and thus we can write 


1 

TT 


r« a cos cot 0 } sin cot 

Jo ' ^ 


(fa) 


1 /■« a cos a)t 1 /■ * 

TT Jo ^ CO^^ ^ TT Jo 


Cl) sm cot 
u“ 4" 


(fco 


In the first integral in the right member, let co 

I sm cot 


Jin 


1 (‘OS atz j ,1 CO sm cot 

T Jo I'n- TT io +"0^2 


r/u) 


(iz 'Tiien 


Wi‘ are now in a jiosition to let a approach zero As this happrms, 

f(t) ~ 77 (0 

and thus we obtain 



(iz ,!/■«> sin 0)1 , 
V 1 ~2 + L 

14-2^ TT Jo CO 



sm cot , 
— - (tco 


This establishes the value of another dehnite inP'gral, without 
benefit of an antideiivative 

14ie use we have just made of the so-called convergence 
factor c““‘ IS both artificial and cluinsv, and it would be desirable 
to make this procedure more systematic To do this, let us detiiie 


^(0 = 


0 

c- “'/(f; 


t < 0 
t > 0 


where /(O is the function of actual interest Then, applying the 
unilateral Fourier transformation to Fit), which surely satisfies 
the necessary (‘onditions if /(t) does, we have, for t > 0, 

Fin = e-“T(0 = ^ g{co)e^^^ dco 

where gico) = jj’ Fis)€~^'’ds = e-’^*f(s)e-'^'‘ ds 

~ Jo* 
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We can now multiply both sides of the expression for F(t) by 
e®‘, getting 

/(O = ^ ff(o>)t“' do) = ^ (7(u)e<“+‘"'‘du) 

AToreover, from the last form of the cxfiression for < 7 ( 0 ;) it is clear 
that ix) enters the analysis only thiough the binomial a -f- za;. To 
emiihasize this fact, we shall w’rile g{a + 'icc) instead of q{ci)) Then 
the equations of the transform jiair become 

^TT 7- « 

{j(n -\r 

I'lnallv, let us put a -f- /a; — a, noliiig tha! 

, (Ka -f lu) do 

do. - - ~ 

i i 

and tlmt \N'h(‘n u? = ^, a -- a — / x and wlnui oi = = 0 , 

( 7 - - « -f ; X Tlien WT have the j)air of eipiations 

/(O = *T~ f ^ g{a)p*’^ d(7 (,{a) =- / }{s)c-°Uis] 

iTTl Ja — 7Bc JO 

Thes(' constitute a Laplace transform pair4 The function g{(T) is 
knowi IS the Laplace transform of j(/) The integral foi j(t,) is 
known as the complex inversion integral. 

We have tliu.s naturallv and inevitably imcounteTed the 
l.aplace transformation thiough our at lemiit to ]>rovulo the uni¬ 
lateral Fourier transfoiniation with a ‘'iHiilt-iid’ convergence 
fact 01 Tins transformation is thc' foundation of tlie modmn lorm 
of th(' operational calculus, which \\a^ onginali'd in fpiite anotlier 
form by the Englisli electrical engnuun Oliver Heaviside around 
1890 In th(' next chapter we sliall develop an extmisivi' list of 
formula^ for the use of the Lajilace liansform itselt, altliough the 
meaning and use of the inversion inlegral we must leave* to the 
chapters on complex-variable theory 


t Most wnlors use / rather than t as the dununy variable in this integral, 
and rather than a m both integials In the next ehaplpr we sliall follow^ 

this convention 

t Named for Pierre Simon de baplaee (174')-1827), who used such trunsfornis 
in hiH researches in the theorv of probability 



CHAPTER SEVEN 


The Laplace 
Transformation 


7.1 

Theoretical preliminaries 

In the last rhapier traced the evolution of the La])lace trans¬ 
formation from the unilateral Imurier inlcRial Our develofimenl 
mad(‘ it clear that, for the Lapla(‘c transform of f{() to exist and 
tor/(0 to he re'-overal)le from its transform, it is sufficient that 
a In every interval of the form 0 ^ h ^ /n, /(O be bounded 
and have at most a finite number of maxima and minima and a 
hnite number of finite discontinuities 
b There exist a real constant a sucli that the iinjiroper integral 

^ (*-"'1 ((Oi ^‘onvergent 

Functions satisfying condition a we shall henceforth describe 

as piecewise regular. 

Condition b is frequently replaced by the stronger, i e , more 
restrictive, condition that 

b' There exist constants a, M, and T such that 
^““‘1/(01 < l^or all t > T 

Functions which satisfy condition b' are usually described as 
being of exponential order. 

Obviously, if < M, then c”“>‘|/(0| < M for all 

ai > a Thus the a required by condition b' is not unique The 
greatest lower bound ao of the set of all a’s which can be used in 
condition b' is often called the abscissa of convergence of /(O 
Under this definition, it is evident that the abscissa of conver¬ 
gence ao may not itself be one of the a’s which will serve in condi¬ 
tion b' P'or instance, if/(O ^ f, then, for every positive a and no 
others, 

^“" 1/(01 ^ 
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remains bounded and in fart approaches zero as t becomes infinite 
Obviously the greatest lower bound of tlie set of all positive 
numbers is the number 0 Henee, in this case ao = 0, even though 
for ao itself 

^■“" 1/(01 = t 

increases beyond all bounds as / —> qo In passing, we note that 
the abscissa of convergence of a function may be negative For 
example, for f({) the abscissa of convergence is —2, since 

as ^ > 00 

e “‘ 1/(01 — 

is bounded for all values of a equal to or greater than —2 but for 
noiH^ less than —2 

Since c~“‘|/(/)| < implies that 1/(0| < /l/c^*', it is clear 
that, if a fuiK lion is of exponential order, absolute' value need 
not remain bounded as / - • oc ^ liul it must not inciease more 
rapidly than some constant multiple of a sinqile exponential 
function of / As the particular functum /(/) = sin shows, the 
(terivalive of a function oi cjponentlul oido os ttcrensardij of 
c r])onential ouiei On the other hand, it is not difhcult to show 
tliat if fit) IS pieren'isi lequlai (vui of crponcntial order^ then 
/(/) df IS also of crpitncntial rndc) 

With a function J(f) satisfying eithei conditions a and b or 
conditions a and b', the l.aidace* transformation associates a 
function of ,s, wlmh w’c shall denote by £|/(0|t sinqily by 
[ f\ This IS defined by the formula 

(1) £|/(0i = jg jiOf 

The funct ion/(/) wdiose l^aplace transform is a given function of .s, 
say 0(s), we shall call thc' inverse of and shall denote by 
file symbol h'lom the concludmg discussion of the 

last chaptei we have good reason to believe that the function 
having <his) for its transform is given by the coniplex inversion 
integral 

(2) /(/) = L 

ZTT? 

where s is the com{)lex variable a + lu, but we shall make no use 
of this fact in the firesenl chapter Indeed, m this chapter we shall 
regard .s as a real-valued parameter 

It is obvious that the derivation of the fundamental proper¬ 
ties of the l.«aplace transform will involve manipulation of the 


t Many writers coiiBistently use only small letters to denote functions of t and 
use ilie corresponding capital letters to denote the transforms of these func¬ 
tions Thus wnat we .shall write as £(/(<)) is often written as F(s) 
f C'learly, the variable of integration t is a dummy variable and can be 
replaced at pleasure by any other symbol From time to tunc we shall find 
it convenient to do this m our work 
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definitive integral (1) This integral is clearly improper, since its 
upper limit is infinite, and it may also be improper because of 
discontinuities of f(t) at one or more points in the range of 
integration However, inasmuch as/(/) is assumed to be piecewise 
regular, these discontinuities can be at worst finite jumps which 
can easily be handled by breaking up the range of integration 
into subranges whose end points are the points of discontinuity. 
We shall, therefore, usually not pay exiilicit attention to the 
possible jumps of f{t) Questions associated with the infinite 
upper limit in (1) are more serious, however, and cannot be 
passed over so lightly. 

At the outset, wc recall that by an integral of the form 
(3) h(s,l) dt 

WC mean lim f h(s,t) dt 

b--« 

and that for this limit to exist for a jiarticular valm* of s, say 
s = 5i, it must, be possible' to show that foi any f > 0 there 
exists a number Ji such that 

I dt ~ dt\^~ h(si,0 dt | < t 

for all valiK's ol b > B The nuinbi'r B will, of couis(', deiicnd on 
€ and in general will also depend on .si, the pailiculai value of 9 
undei consideration It mav hapiien, howevi'i, that oik' and the 
saint nun.her B will st'rvc uniformly, or etpially well, foi all 
members of some set of ,s-values If and only il th^^ is the case, 
the integral (3) is said to converge uniformly, or to have tht* 
projieny of uniform convergence, ovei that particular set of 
s-values 

The imjioitancc of uniform convcigi'iice is ajiparcnt from 
the following theorems, w^hich wc shall have to use in tins chaptei 
but w'hose })roofs we leavt' to more advanced texts * 


THEOREM 1 

If g{s,i) is a continuous function of s and t for a ^ .s ^ /3 and t ^ a, if f(0 is at 
least piecewise regular for t ^ a, and it the integral (/(,s) — dt con- 

vciges uniformly over the interval a ^ .9 ^ then (i{s) is a continuous function 
of s for a ^ s ^ (3 

Since the definitive property of a continuous function is that 
lull = (j{so) 

this theorem states, in effect, that under I he appropriate condi¬ 
tions the limit of (/(.s') can he found by taking the limit inside the 
integral sign 


* See, for inatance, H S Carslaw, “Fourier Senes,” pp 198-201, Dover 
PublicatioiiB, Inc , New York, 1930 
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theorem 2 

If g{sj) is a continuous function of ,v and t for a ^ a ^ p and / ^ a, if f(t) is at 
least ineccvvisc regular for t ^ a, and if the integral G{s) = ^‘on- 

verges uniformly over the interval a ^ s ^ /9, then 

G{s) (is ~ fit ds = ^ fit)g(s,t) ds dt 

In words, this theorem states that under the appropriate condi¬ 
tions the integral of G(s) can he found by integrating inside the 
integral sign 


THEOREM 3 

ff (j{s,() and g„is,t) = ^ continuous functions of s and t foT a ^ s ^ ^ and 

/ ^ ^ 7 , if /(/) IS at least jnecewise regular for / > a, if liie integral 

=-' f /(0r/(^0 (it 

Ja 

('oii\eiges, and if dl converges umtorinly over the interval a ^ s ^ 0, 

then 

r/'(.s) = 'I j‘msM <’t = dl 

for all values of 5 such t \t a % s ^ ft 

In woids, Theorem 3 stales that, under the approjniate condi¬ 
tions, th(‘ derivative* of G(s} can he found hv difTeit'ntlating inside 
the integral sign 

Obviously, it w(‘ take g{sj) to he the continuous function 
c“ and take a = 0, the integial (/(,s) leteried to 111 the last, three 
theorems is pn cisely the Lai)lace transform of the function/(O 
However, bi'tore we can ajiply these theorems to out work we 
must determine under what conditions the Laplace transform 
integral converges iiniionnly \V(' begin by ]:)roving the following 
weaker result 


THEOREM 4 

It /(O is piet'cwise regulai and of exponential order, then 
^ 1/(01 = P Riyr-’dl 

converges absolutely for any value of .v greater than the abscissa of convergence 
ao of fit) 

PROOF To establish this theorem, we must show that 
(4) liin r l/(0e-"‘| A = lini f‘'\f{i)\e-’'dt 

exists, and to do this it is necessary that we have an upper bound for 1/(01 
t ^ 0 Now, by hypothesis, fit) is of exponential Older and, therefore, has an 
abscissa of convergence ao- Hence, there exist numbers Mi and T such that for 
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all / > T and any a greater than but bounded from an, that is, any a such that 
a > ai > ao, we have 

1/(01 < 

Moreover, since f(t) is piecewise regular, it is bounded over the finite interval 
0 ^ t ^ T; that is, there exists a positive number M 2 such that 

1/(01 < M 2 = (M 2 e-“‘)e“‘ forO ^ ^ r 

Thus if we let M be the largest of the three numbers Mi, M2, M2e~°'^,-\ it is clear 
that 

1/(01 < for all t ^ Q 


Hence, returning to the integral in (4) and replacing/(O by its upper bound, we 
have 


I = \f(t)\er'‘dt £ Me“er-‘dt = 


— (S — Of) 


M 


(1 


a)b) 


Now if s > a, the last expression increases monotonically and approaches 
M/(s — a) ELS h becomes infinite Therefore, 

/ ^ ’ - S > a > ao 

s — a 


Since 1hf‘ integrand of I is everywhere nonnegative, it is clear that f is a mono- 
toi^h'ally increa'^ing function of h. Hence, being bounded above, as we have just 
shown, it must apfuoach a limit as b becomes infinite Since .s > a > ao 
IS clearly equivalent to th(‘ condition .s > ao, the theoieni is estabhsbod 

Since the absolute value of an integral is ahvays eipial to or 
less than the integral of the absolute value, it follows from the 
preceding discussion that 

Hence, letting 6—► 00 ^ we have the important result 


THEOREM 5 

If f(0 IS piecewise regular and of exponential order with abscissa of convergence 
ao, then, for all values of s and a such that a > a > ay, 

M 

|£|/(01l ^- where M is independent of s 

s — a 

Finally, from Theorem 5 we draw the following interesting 
conclusions 

COROLLARY 1 

If f{t) 18 piecewise regular and of exponential order, then £|/(0| approaches zero 
as 8 becomes infinite. 


t Both Ml and must be considered, because if a > 0 then Mz is the 

maximum of on 0 ^ ^ T, whereas if a < 0 then is the 

maximum of Mitr"* on 0 ^ ^ T 
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COROLLARY 2 

It /(/) IS piecewise regular and of exponential order, then s£\f(t) | is bounded as s 
becomes infinite 

These corollaries make it clear that not all functions of s are 
Laplace transforms—or at least not Laplace transforms of func¬ 
tions of the “respectable” class defined by conditions a and 
For instance, 4>(s) ~ s/(s — 1) does not approach zero as 
becomes infinite, lienee it is not. the Laplai'e transform of any 
“respectable” function Also, although = l/\/s does 

approach zero as s becomes mfinile, it is not the transform of any 
“respectable” function, since s4>(s) = \/s is no! hounded as s 
becomes infinite 

We are now in a position to establish the uniform conver¬ 
gence of the integral defining £|/(/)| 


THEOREM 6 

If/(/) IS piecewise legular and of extionential order with absiussa of convergence 
ao, then, for any number .So > ao, 

^(/(oi = ’‘<it 

converges uniformly for all values of s such that .s ^ .s*,, 

PROOF To jirove this theorem, we must --liow that, given any t > 0, there 
exists a number /f, d(‘i)(‘ndmg on f but not on .s, such that 

I f for all h > B and all .s ^ .so 

Now I ^ l/(0k’ 

and we know that for s > ao the integial on the right ayiproaches z(to as b becomes 
infinite, since this is impln'd by the fact that 

is converg(‘nt for .s > ao (Theorem 1) In other words, given any f > 0 and any 
An > an, there exists a number B such that 

di < t for all 6 > B 

Now if A ^ Ao, it IS obvious that c '' ^ c '"* Hence, 

^ \f(0\e~’‘dt g |/(0|e“'"‘rf< 

and so for any a ^ ao the integral on the left is less than t for all values of h greater 
than the particular B which sufhees for the integral on the right This value of B is 
clearly independent of a, and so the proof of the theorem is complete 

In succeeding sections we shall find that many relatively 
complicated operations upon f{t), such as differentiation and 



233 


THE UPLACE TRANSFORMATION 


CHAP 7 


integration, for instance, can be replaced by simple algebraic 
operations such as multiplication or division by , 9 , upon the trans¬ 
form of/(O- This is analogous to the way in which such operations 
as multiplication and division of numbers are replaced by the 
simpler jiroeesses of addition and subtraction when we work not 
with the numbers themselves, hut with their logarithms Our 
primary purpose in this chapter is to develop rules of transforma¬ 
tion and tables of transforms which can be used, like tables of 
logarithms, to facilitate the manipulation of functions and by 
means of which we can recover the proper function from its 
transform at the end of a proVilem 


EXERCISES 


1 Prove that a function f{t) is of exponential order if and only if ,s can he chosen so that 
llin c" *'/(<) = 0 If fit) 16 of ex])onentn\l older, show that its abRcissa of (onverneine ao is 

t-* B 

the greatest lower bound of all valuen of s such that lini (• •'f(t) = 0 

2 Which of the following functions arc of exponential order (a) fb) tan t, (c) fd) 
eo8h t, (e) I/I, (f) 


8 Prove that, if a jiwccwise ri'gulai fuiution Batisfies condition b', it also Batisfirs irondition b 
(Hint The proof of this is vei v touch like the pi oof of Thtoiein 4 ) 

4 i rove that, if a piecew ise reguLu function Hatiafies condition b, it does not ne(*essaril> 
satisfy condition b' Hint C'oriHider the function 



/ “ n 
/ n 


n = 0, 1, 2, 3, 


6 Prov(‘ that, if f{t) is piecewiHe ri’gular and of exponential order, then J f{t) di is also piece- 
wise legular and of exponential order Show also that, if and «i are, 1 espec Lively, the 
ahscisaas of convergence of/(O and J(() dt and if ao ^ h, then Is it necossanlv 

true that ai ^ 00 if 00 < 0? 


7.2 

The general method 

The utilify of the Laplace transformation is liased pnmanly upon 
the following three theorems 

THEOREM 1 

-f CzhiO] = Ci£{/i(01 + ^*2£l/z(01 
PROOF To prove this, we have by dehnition 

JC(c^fi(0 + C^2(0I = + c,^2{0]e-“ dt 

= Cl ^ /i(0«”'' + C2 ^ dt 

= fiJCl/,(<)! + c,JE(/2(i)l 


as asserted 
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The extension of this theorem to linear combinations of more than 
two functions is obvious 


theorem 2 

If /(/) is a continuous, piecewise regular function of exponential order whose 
derivative is also piecewise regular and of ex}ionential order and if f(t) approaches 
the limit/(O'*^) as I approache.s zero from (he right, then the Laplace transform of 
f'it) IS given by the formula 

£(r(oi = s£,\f{()\ -/(o+) 

provided s is greater than the abscissa of convergence of/(0 

PROOF To prove this, let us suppose foi definiteness that tluTc is a single 
point, say / - In, where, thougli f{f) is itsiOi continuous, its derivative has a hnite 
jump, as suggested by Lig 7 I '^Idien, by (hdinition 

£|/'(0I = 

= Inn I "'j'iD. -dl 4 f \ 

If we use integration by jiait.s on these integrals, (dioosing 
u ^ ^ dv - J'(t) dt 

du = — V ~ f(t) 

we have 

iil/'(OI - liin r^-W) r'’+ ,s 

f>xM «i- ‘0 1 ^ U. Js, 

+ I,'.,., + .s 


FIGURE 7 1 

A ooiitinuouH 
function whose 
Henvativo lias a 
point of 
discontinuity 
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In the limit the two integrals which remain combine to give precisely 

« I" me—dl = s£ 1/(01 

Similarly, the first evaluated portion yields 

) - m) 

and tlie second yields simply 

because, since f(t) is of exponential order, s (‘an be chosen suthciently large [i e , 
greater than the abscissa of convergence of/(/)] that the contribution from the 
upper limit is zero Now/(0 was assumed to be continuous Hence at to (as at- all 
other points) its right- and left-hand limits must be eipial Therefore, the terms 

c-*V(fo-) and 
cancel, leaving finally 

-Cl/TOI = <s£j/(0| — /'(0+) as asserted 

The extension of the preceding proof lo fuiu'tions whose' deriva¬ 
tives have more than one finite jump is obvious Tlie exiensjon 
of the theorem to the relatively unimportant (-ase in which f{t) 
itself IS permitted to have finite jumps is indicated in Exercise I-? 

COROLLARY 1 

If both f[l) and /TO are continuous, pu'cewise regulai fuiu'lions of exponential 
order and if f"(t) is piecewise regular and of exiionentlal order, then 

lii/'Toi - s^£i/(oi “ «/(o-^) - r(o^) 

where/(O') and/'(O') are, respectivc'ly, the values that f(l) and/'(/) approach 
as t a[)proaches zero from the right 

PROOF ddus result follows immediately bv apfilying Theoiem 2 twice to/"(/) 

iii/"(0i - JE|[r(0J'i - .s^i/Toi “/(oo 

= 'Si^Ti/(oi - fio^n -rm 

= .s-ii(/(0l ~ ‘S;/(0') - /'(0+) as asserted 

The extension of this result to derivatives of higher order is 
obvious (F^xercise 1) 


THEOREM 3 

If f(t) IS piecewise regular and of exponential ordei, then the Laplace transform 
of fj(t) dl IS given by the formula 

■c {/'/■(<) rff} 

PROOF To prove this theorem, we have by definition 

where the dummy variable .r has been introduced for convenience If we integrate 
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ihe las(, integral by parts, with 

?/ = f(x) dx dv = dt 

du — /(/) dt t; = —- 


we have 


^ I/.'■'''I'*! 


'dt 


Since J{t) IS of exponential ordin, so, too, is its integral (F^xercise n, Sec 7 \) 
Heme .s can be chosi'ii siifhciently la;g(‘ Hiat (he inlegiated jiortion vanishes a 1 , 
Ihe upper limit, leaving 


£ 1 fi/) .//} - I + ’ £(/(0l 


as a^se^t(H^ 


Th(‘ exttuision oi this lesiill (o icpeatcal integrals ol /(^/) is olivious 
(Kxi'n ISC 2) 

Ahfiough we n(‘(‘(l manv more formulas before the J^ajilace 
1 ran^loiinal mil can be applied ettcctivelv (o -pecihc prolilems, 
Tbenrems I, 2, and 2 allow u^ to outliiu all ihe essential sle])s in 
llu' Usual applnalioii of this im'lhod to ihc solution of differiMit lal 
eijuations Supjiovf' (liat \\(' ai(‘ given the ('(juation 

(11/" -f bi/' -h n/ [{/) 

If w'(' ‘ake th(' haplaci' tiansfmm of l)(»lh sides, \\r have bv 
'riu'OKMii 1 


(ii^\}/"\ bA:\i/'\ -f-ci*|v} - ;/'■(/) I 


\ow applving "riieonmi ‘2 and its coiollarv, wa* have 

— -svo — vl.l -k — Vcl 4 = -ii I/■(/)} 

wliere //u and //oari' Ilu‘ givmi initial vahu's of i/ and i/' ('olh^'ting 
teiiiis on eij|/y| and then soKing foi wi‘ obtain tinally 

A: \ f(l)\ f (u.s I h)>/^, f- af/u 

^ ^ , I , 

(IS- -p US -f- ( 


?sow'/(0 IS a givi'ii fum turn of t, hence its Laplaci* transfoim 
(if it exists) IS a }i('ifectly didinitt' function (^f s (although as yt‘t 
we have no spe(‘j|ic formulas loi finding it) Moreover, i/u and 
//o are definite nuinbeis, known from tlii' data of the problem 
Hmice the transform of // is a completely known function of .s 
Tlius if we had availabh* a table of tiansforms we could hnd in it 
the function i/{t} having tlu' iight-liand side of llu' last e(iualmn 
for its transform, and this lutjrtion would he Ihc jonual solidton (o 
om 'problem, luiiinl (ouditious and all Thi* ioimal solution could 
then b(' sulrstil tiled into th(‘ given differential equation to vi'rjfy 
that it wais imha'd the genuine solution 

This brief discussion illustrates Ihe tvvo great advantages of 
the Laplace transfoianation in solving linear, constant-coi'llicieni 
diffcKuitial eciuations' first, the w^ay in vshich it ieduc(‘s the oroh- 
lein to one in algebra, second, the automatic wav in which it lakes 
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care of initial conditions without the necessity of constructing a 
general solution and then specializing the arbitrary constants it 
contains (Nearly, our immediate task is to implement this process 
by establishing an adequate table of transforms 

EXERCISES 

1 Show that £{/'") = — s®/o - .'»/o — /o' What is {/f") | 

2 Show that 

£ { + ■ f° j‘ 

8 If f(t) satisfies all the conditions of Theorem 2 exr(‘pt that it has an upward jump of magni¬ 
tude Jo at i = ta, show that 

£|/'(0I - s£(/t -/.) - JoP-*‘o 

4 Show that 

£(/(a01 = -£{r(01 I , 

a la_+. 

a 

6 a Given £lcos t) = ^/(s* f 1), use the result of Kxeri ise 4 to determine i‘ [ros uG 
b Given i?|Bin <1 * 1/f.s* -f- 1 ), us(‘ the result of Kxereise 4 to (h'terrnine £lsin at] 

6 Kxnlain how the Lnplaee transform ean be used to solve ii system of simultaneous liiu‘nr 
dirTerential equations with constant coefficients In particular, given that y = 7/0 and 2 = Zo 
when t «• 0, obtain foimulas for the Laplace transforms (*i i/ and 2 if 

dy dz 

Oi — -f- hxy + Cl — + diz = /,(0 
(it dt 

dy dz 

a* — -f t>2y + Ci —h (hz = fi{t) 
dt dt 

7 The function 

5[/ff)] e f(t) sm nl dt n ^ 1, 2, 3, 

18 called the sine transform of/(f) Show' that 

- -uKSif) +Tl[/(0) - (-l)"/(7r)! 

8 The function 

f 1/(0] ^ fit) C 08 nt dt 77 = 0, 1, 2, 

la called the cosine transform of f{t) Obtain a formula expressing C(J") in terms of C{f) 

9 Let 7’[/U)| be a general integral transform 

Tim] m jf f{i)K{>,i)di 

where Kis,t) is the so-called kernel of the transformation Obtain conditions on /v(sj) ao 
that 7'(r) and 7'if") contain no terms involving the evaluation of /or any of its derivatives 
Find at least one kernel satisfying these conditions. 

10 If/'') and fit) are both piecewise regular and of exponential order and if fit) is continuous 
anii^^/(0'^) »" 0, show that os r becomes infinite £(/(f)) tends to zero at least as rapidly os 
l/«* Can this result be generoiized? 
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7.3 


The transforms of special functions 


FIGURE 7 2 

'I’ho umt http 
function ?/(0 


Among all the functions whoso transforms we might now think 
of tabulating, the most imfiortant are the simjile ones 

cos hi sill ht 
and the unit step function, 



shown in Fig 


^ < 0 
/ > 0 

7 2 Once we know the transforms of these fune- 


I 


I 

tions, nearly all the formulas we shall need can be obtained 
through the use ol a tew addilional gt'iioral theoiems w^hich we 
sliall establish in the next, section The specific results are the 
followr"- 


FORMULA 1 


1 

s + a 


FORMULA 2 


£ (cos bt ( 


-f 9 


FORMULA 3 

£ (sin bt ) 


s2 -{- 62 


FORMULA 4 

£(f»l 


/ iXnJ- \) 
) 


rz > — 1 

71 a positive integer 


FORMULA 5 


JCkWI = 


To prove Formula 1 we have simply 




g—(ii+alt ^ J 

— (s + a) 0 s -F a 


if s + a > 0 
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( 1 ) 


(2) 

(2a) 


To prove Formula 2, we have 
£(cos6<| = cos bie—dl = 


s 


To prove Formula 3, we have 


£(siii 


“I - r> 


sm bi (it = 


-}- t)^ 

h 

6*2 + b^ 


(~ s cos 6^ 4- 6 sin bl) j 
if s > 0 

( — s^mbt — b cos bt) | 
if s > 0 


Before we can prove Formula 4 it will be necessary for us to 
investigate briefly the so-called gamma or generalized factorial 
function defined by the equation 

r(x) = dt 

This improper integral can be shown to be convergent for all 

j > 0 

To determine the simple f)roperties of the gamma function 
and its relation to the familiar factorial function 


n’ = n(n — 1) • 3 • 2 • 1 

defined in elementary algebra for ])Ositive integral values of n, let 
us apply integration by parts to the definitive integral (1), taking 

u = e~^ dv = dt du = —e-^dt v =- 

X 

Then r(j) = -- I* H- - f’“ 

X \o X h 


Under the restriction a: > 0, the integrated portion vanishes at 
both limits By comparison with (1), il is clear that the integral 
which remains is simply Tfj’ -f- 1) Tiius we have established the 
important recurrence relation 


r(x) 


rjx + 1 ) 

X 


X > 0 


or 


xr(x) = r(x 4-1) 

Moreover, we have specifically 

r(l) = p e-‘dl = -e-'l" = 1 
Therefore, using {2a), 

r( 2 ) = 1 r(l) = 1 
r(3) = 2 • r(2) =2-1=2! 
r(4) = 3 ■ r(3) = 3 • 2! = 3! 
and in general 
r(n + 1) = ft' 


(3) 


Ti = 1, 2, 3, 
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The connection between the gamma function and ordinary 
factonals is now clear. However, the gamma function constitutes 
an essential extension of the idea of a factorial, since its argument 
X is not restricted to positive integral values but can vary con¬ 
tinuously over any interval which does not contain a nonnegative 
integer 

From (2) and the fact that r(l) = 1, it is evident that r(r) 
becomes infinite as x approaches zero It is thus clear that r(.r'' 
cannot be defined for x = 0, — 1, — 2, . in a way consister t 

with Eq (2), hence we shall leave it iindetined for these values of 
X For all other values of x, however, Fti) is well defuicd, the use 
of the recurrence formula (2a) effectively removing the restriction 
that X be jiosilive, which the integral definition (J) recpiires By 
methods which need not concern us hen*, tables of r(i) have 
been constructed and can be found, usuallv as tahJes of log r(.r;, 
in most elementary handbooks Because of the recurrence formula 
which the gamma function satisfies, these tables ordinarily cover 
only a unit interval on a, usually the interval 1 ^ r ^ 2. A plot 
of r(x) IS shown in Fig. 7 8 


FIGURE 7 3 
Plot of ttic 
fuiH tion 

V =-- rfj-) 



EXAMPLE 1 


What IS the value of I 



This integral is typical of many which can he reduced to the standard form of the gamma 
function by a suitable substitution In this case it is clear on comparing the given integral with 
H) that we should let 


z - dz • dt 

KfUitiR 7 - j“ - U 

Since r('^) cannot bi' found in the usual table, which lists r(x) only for 1 ^ x ^ 2, it is neces¬ 
sary to use the recurrence relation (2) to bring the argument of the gamma function into this 
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interval; 



1 rm 

3 


2 

= - (0 88623) 
3 


0.590821 


Returning now to Formula 4, we have 

£{r) = t’'e-’‘dl 


In an attempt to reduce this to the standard form of the gamma 
function, let us make the substitution 



Then 



£|«"l = = r 

Jo \sj S S""' ^ Jo 


dz 


r(7^ 1) 

Sn+l 


Since r(7i 4- 1) = ri’ when n is a positive integer, this establishes 
the second part of Formula 4 also 

It IS interesting to note that, if n is negative, 




r( n + 1) 

gn 


is not bounded as .s —> qo Hence, according to Corollary 2, 
Theorem 5, Sec. 7 1, this function of .s is not the Laplace trans¬ 
form of a piecewise legular function of exponential order This, 
of course, is obvious, since when n is negative, though of 
exponential order (with abscissa of convergence ao = 0), is not 
bounded j.i the neighborhood of the origin and so is not piecewise 
regular It can be shown, however, that the improper integral 
defining £(C| exists for n > —1 although it does not exist for 
n ^ —I Formula 4 must theiefore be qualified by the restriction 
n > —1. 

Formula 5 can be obtained immediately by taking ii = 0 in 
Formula 4. 


EXAMPIE 2 

Whftt IS the Laplace transform of sinh bt? 
Since sinh bi =» (f*** — e~^*)/2, we have 


I 2 2 \,s - ^ s + 6/ s“ 


ii(8inh W) ■= £ 

The analogy with Formula 3 for the transform of sin hf is apparent 




EXAMPLE 3 

If £|j/(0l “ (fi + !)/(«• -}- a — 6), what is y(t)^ 

None of our formulas yields a transform resembling this one However, using the method of 
partial fractions, we can write 

^ + 1 ^ __ a -f 1 _ _i4__ _ A(8 -t- 3 ) -f Bis 

«• + fi — 6 (a — 2)(s + 3) 8 — 2 8 + 3 (s — 2)(.9 -f 3) 


t Actually the value of r(t^) is known exactly and in fact is equal to 
(Exercise 10) Hence, in this example / “ V^/3 
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p"or this to be an identity we must have 

s + 1 - A(s + 3 ) + - 2 ) 

Setting s = 2 and s «= —3m turn, we find from this that A = B 




^ ^ 2 \ 
5 \s - 2 ,s + 3 / 


Formula 1 can now be applied to the individual terms, and we find 

Vit) = ?^(3c« -j- 2c-»') 


Hence 


EXAMPLE 4 

Solve for y(l) from the simultaneous equations 

y' + '2y b ^ z (it = —2u{i) 

?/' -f- s' -b z = 0 

if t/fl = —5 and = 6 

We begin b> taking tlie Laplace transform of each equation term by term 

[.S'£ (7/1 -f 5) -f- 2ii (?/) + 4: (z I - - 

« H 

fs£{;/l + 5l + (.si:|2| - ()I + f U) =0 

Obvious airnplificationfl then lend to the following pan of linear algebraic equations in the tians- 
forms of the unknow'ri functions y{() and z{t) 

(s* -f 2,s, j y) -{- fiAI|z) = — 2 - fix 
.sJLiji/l -b (fl -f- O^lzj * 1 

vSiiiee It is y(t) that we are asked to find, we solve these simultaneous equations for .lilyj, getting 

-oi* -_7s - 8 
«* -b 3.S® — 49 

Applying the method of partial fractions to this expression, we have 

-5a’ ~ 79 ^ 2 _ J _ ^ 

^ ,s* -b 3s’ — 4s 8 s — 1 s -b 4 

Finally, taking tlie inverse of each of these terms, w^e find 
y(t) = 2u«) - 4c‘ - 3e~« 


£1?/) = 


-2 - 5 
1 

s’ -b 2s 


t) 

S 4 
G 

s 4 1 


EXERCISES 

1 What IS £ jeosh } ? 

2 What 13 £ jeoH (at -h b) j? [Hint First '^xpress cos (at 4- b) aa^the difference of two terms 1 
8 What IS £ (cos’ bij ? (Hint First express cos’ os a function of 2bt.) 

4 What is £((f 4- D’l? 

8 Find the inverse of each of the following functions: 

^1 1 ^ 2s 4-3 84"3 

^ 8 4- 3 7* ^ 8>~4- 9 «* * (s 4- 1)(8 - 3) 

6 Find the solution of each of the following differential equations: 

a y" -h 4y' - 5y = 0 j/o “ 1, I/i - 0 

b y" - 4i/ ™ 0 I/O “ — 1, y'o “ 1 
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c 4j/" + y - 0 2/0 - 2, vi “ 1 

d y" + 4y - u{t) 2/0 = yi - 0 

e y” -f 3y' + 2]/ «■ c* Vo * 1, vj " 0 

f y'" + 6v" + 112/ -f 6v - 0 Vo “ 2. v'o “ 1, Vo 1 

7 Find the solution of the following system of equations* 


V' + V + 2z' + 32 - e-‘ 
3v' - V + 42' -f 2 = 0 


Vo =■ 0, 2o - 1 


8 Find the solution of the following system of equations* 

(D + l)v -h (2D + 3 ) 2-0 

(D - i)v + (3/) - 8)2 - sin « ” 


0 


9 Evaluate each of the following integrals 


a [ — ^dx h f € dx c f (i + l)*e **di 

Jo Jo Jo 

d [ — dx (Hint, c* — c®*”") 

Jo c* 

10 Show lhat =■ y/ir [Hint First show' r(t^) ^ 2 rfj- = 2 ^ e~«*dy Then 

multiply these integrals and evaluate the resulting reiw^ated integral by changing to polar 
ourdinatcs ] 


7,4 

Further general theorems 

We are now in a position to derive a number of theorems that 
will he of considerable use in the a^iplication of the Laplace 
transformation to practical jiroblerns We begin with a result 
which alIow^s us to infei th(‘ behavior of a function f{i) for small 
positive values of I from t,he behavior of ii (/(O 1 for large positive 
values of 5 


THEOREM 1 

If/(0 and/'(0 are both piecewise regular and of exponential order, then 
lim s£,{f(t)\ = lim f(t) = /(0+) 

PROOF For convenience we shall prove this under the additional assumption 
that/(/) is continuous, leaving as an exercise the proof under the less restricUv<‘ 
conditions of the theorem as stated. We may thus begin with the result of Theorem 
2, Sec 7.2, namely, 

Plenc^'^ ^akiiig the limit of each side, 

(1) lim£|/'(0) = lims£(/(0} -/(0+) 

t —»« *—»« 
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However, under the conditions of the theorem, it follows from Coronary 1, 
Theorem 5, Sec. 7.1, that 

lim £(/'(01 = 0 

a—¥ « 

Therefore, from (1), 

lim «£{/(0) =/(’0+) as asserted. 

9 -* « 

An analogoas result which allows us to infer the behavior of a 
function f(t) for large positive values of t from the behavior f 
£ 1 f(t) I for small values of s is contained in the following theorem 


THEOREM 2 

If f{t) and f'(t) are both jnecewi.se regular and of exponential order and if the 
abscissa of convergence of i'(() is negative, then 

lim s£\f(t)\ = lim f(t) 

s—*0 t~* -f “ 

provided these limits exist 

PROOF Here, as m the proof ot Theorem 1, we shall base our argument on the 
addiuonal assiimjition that f(t) is continuous Then again we may take limits in 
the result of Theorem 2, Sec 7 2, getting 

hm £l/'(01 = Inn ,s£|/-(0) - 

or 

(2) hm .s£(/(0| - liin £{/'(0| + 

s-*0 s-»0 

But lim £(/'(/)! = lim [ di 

B »-4() 

and under the conditions of the jiresent theoicm wv can invoke* I’heoroms 0 and 1 , 
Sec. 7 1, and take the limit on the right inside the integial sign Thus 

lim£|/'(/)| = [ r(/)(hm r = f I'(0 (It = I it) \ 

a-pi) 8 U) I 

= lim/(0 -/(CH) 

1 -*« 

Substituting this into (2) wo have finally 

lim ,s£(/(01 = [hm/(/) — /(OM] 4-/(O’*") 

.s—*0 r—•« 

= hm /(/) as asserted * 


* In realistic Hiiplicatioris of this theorem, iil/(p I will he kno^vrl, but/(0 and 
Its abscissa of converneru e ill lu* unknown Henre it is desirable that eondi- 
tions for the us(‘ of the theorem be expressed in terms of | rather than 

/(/) This ran be done, ’'inee it is possible to show that Theorem 2 cannot be 
applied if tlu re is an} ^alue of .s with iionneKative real jiart for which s£|/(p 1 
is unbounded, but ran be ajijilied if no sik ii value exists For example, even 
though lim .s/(.5“ f 1) exi.sts, Theorem 2 canimt be apjilied to £l/(p) ** 

1 >n 

!/(';■ + 1), since tins is unbounded foi the values s ^ f i ^ 0 j: j In this 
case, of eoursc, f(l) ^ sin i, and clearly lim sin t does not exist 
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When the Laplace transform of an unknown function f(t) 
contains the factor 5,t it is often convenient t-o find/(0 by means 
of the following theorem 


THEOREM 3 

If f(t) IS piecewise regular and of exponential order, if £{/(/)} = s0(s), and if the 
inverse of the factor <t>(s) is continuous for t > 0, then 

PROOF To jirove this theorem, let F(t) = function whicli 

has 0hs) for its transform If F{t) is continuous, as assumed, then, by Theorem 2, 
Sec 7 2, 

£|F'(/)) = s£\F(l)] - F(0^) = s4>(s) - Fion 
But, by Theorem 1, 

F(0'^) = lim sSL\F{t)\ — Inn .s(/)(s) = 0 

where the last step follows from C'orollaiy 1, Theorem 5, Sec 7 1, since is 

the transform of the function /(/), which, though unknown, is B.ssumed to be 
"respectable " Hence, 

£ 1/(01 = £ 1^(01 

since each is equal to <s0(s) ThereforeJ 

f(l) = as assc'it.ed 


EXAMPLE 1 

What la Ai- ‘ -f 4)} 7 

By Formula 2, 7 \vc* se(‘ imimMlintely ttmt the required inverae la f(t) = coa 2t 

However, il is intereHling that we can also obtain this result by suppECSRUiK the factor s, finding 
the inverse Fit) of the rcrnainmg pcution of th(‘ transform, namelv, i C 

1 

f 4 

and then diffeioutialirig this inverse according to Theorem 11 


fit) « 


d 


( I d /Hill 2l\ 

4-4) ^ dt\ 2 / 


eoR 2l 


as before The usual applicalions of this theorem are, of course, not of this trivial cliaracfor 


t This can always be arranged, of course, by multiplying and dividing the 
transform by s, that is, 4>{s) s .s[0(.s)/'il 

X This of course, assunirs the “olivious” theonmi that, if two functions 
have tne same transfoim, they are identical This is strictly true if the func¬ 
tions are continuous It discontinuities are permitted, the most we ran say is 
that two functions with the same transform cannot differ over any interval 
of positive length, although thev may difler at various isolated points A 
detailed discussion of this result (Lerch's theoiem) would take us too far 
afield 
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When the Laplace transform of an unknown function f(t) 
contains the factor l/s,t it is often convenient to find f(t) by 
means of the following theorem ■ 


THEOREM 4 

if f(i) IS piecewise regular and of exponential order and if £|/(0t = then 

/(<) = /JjE->U(s)| dt 

PROOF To prove this theorem, let F(t) = £,~^ (0(.s)) be the function which has 
0(&) for its transform Then, by Theorem 3, Sec. 7 2, 

j‘F{l) rf/ = i JC|F«)1 + I f°F(0 dt = i jelFCt;) = 

Thus both /(O and F{t) dt ^ dt have 4>('i)/s for their Laplace 

transform, and so must be equal, as asserted 


EXAMPLE 2 

What IH £“' {1 /«(«* -f- 4) 1 ^ 

Here, iiHing the last theorem, we first suppress the factor 1/s, petting 


0(s) 


1 

s 4 


Jiy Forrriula 3, Sec 7 3, tl' inverse of tins ls F(i) *= * 2 2t Finally, we obinin f{t) by integrat- 
jnp Fit) from 0 to I 

ft sin 2t cos 2t \t ] — cos 2t 

fa)- I 

One of the most useful properties of the Laplace transforma¬ 
tion IS contained m the so-called first shifting theorem: 


THEOREM 5 

PROOF By definition, 

£(«-«'/(<) I = I" lr-“f me-' dt = 

and the last integral is in structure exactly the Laplace transform of f{t) itself, 
except that s a takes the place of 5 

In words, Theorem 5 says that the transform of times a func¬ 
tion of t IS equal to the transform of the function itself, with s replaced 
by 8 a 

As a tool for finding inverses, this theorem asserts that, if we 
reverse the subshtution ► s -}- a, that is, if we replace s by 
s — a, then the inverse of the modified transform <l>{s — a) must 
be multiplied by to obtain the inverse of the original trans¬ 
form This procedure is summarized m the following result 


t This can always be arranged, of course, by multiplying and dividing the 
transform by a, that is, </>(«) — (1/«J[80(8)] 
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COROLLARY 1 


By means of Theorem 5 we can easily establish the following 
important formulas 


FORMULA 1 


£(e”"‘ cos j 


s -f- a 


FORMULA 2 


£(e~“*sinb^l = 


FORMULA 3 


(8 + ay + 6* 

b 

(«“ + ay -h 
r(n + 1) 




(s + a)-+‘ 
n\ 

(a -h a)"'*'* 


n > — 1 

n a positive integer 


EXAMPLE 3 

If £|y) - (28 + 5)/(«* + 4« + 13), what is y? 
By obvious manipulations we obtain 


^1,1 „ „ 2 r 1+’ r._ j._1 

+ 3* l_(<+2)* + 3*J 3L(»+2)> + 3>_ 


Hence, by Formulas 1 and 2, 

V = 2e~*‘ cos 3f -f- sm 3< 


EXAMPLE 4 

What is the solution of the differential equation 


v" -f 2^/' + V “ 


for which j/o “ 1 and j/o — —2^ 

Transforming both sides of the given equation, we have 

- a + 2) + 2(«^|yl - 1) + £|j/| 
(a* + 2s + 1)£|!/} 

£|v) 


1 

1 

(s 

-_L_ + _i_ 

(s + 1)< (« + !)• 


+ « 


By Formula 3, the inverse of the first fraction in £ly| isPp ' To find the inverse of the 
second fraction we can write it in the form 


9 + 1 - 1 1 1 

(« -MO* " i ~ fa +T)» 

and take the inverse of each term, or we can suppress the factor a, take the inverse of what 
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remains, and differentiate this result. By either method we obtain immediately Hence 

tv* 

" IT + ' 

In this example the characteristic equation of the differential equation has repeated roots, 
and moreover the term on the right is a part of the complementary function, yet neither of 
these features requires any special treatment in the operational solution of the problem This is 
another of the many advantages of the Laplace transform method of solving linear differential 
equations with constant coefficients 

In some problems a system which becomes active at f = 0, 
because of some initial disturbance, is subsequently acted upon 
by another disturbance beginning at a later time, say t = a. The 
analytical representation of such functions and the nature of 
their Laplace transforms are therefore a matter of some im])or- 
tance To illustrate, suppose that we wish an expression describ¬ 
ing the function whose graph is shown in Fig 7 4o, the curve 



FIGURE 7 4 

Plot describing the graph of a function which has been tranKlatcd and "cut off " 


being congrueni to the right half of the jiarabola y ~ shown in 
Fig 7 4b It is not enough to recall the translation formula from 
analytic geometry and write [•{t) = (f — a)^ because this equa¬ 
tion, even with the usual qualihc.ation that j{t) =0 for f < 0, 
defines the curve shown in Fig 7 4c and not the required graph 
However, if we take the unit step function and translate it a units 
to the right by writing u{t — u), we obtain the function shown 
m Fig. 7 4d Since this vanishes for f < a and is equal to 1 for 
I > a, the product (/ — a)hiit — a) will be identically zero for 
t < a and will be identically equal to (f — a)^ for f > a and hence 
will define precisely the arc we want. More generally, the 
expression 
f{t — a)u{i — a) 

represents the function obtained by translating f{t) a units to 
the right and "cutting it off," i.e., making it vanish identically 
to the left of a 

EXAMPLE 5 

What is the equation of the function whose graph is shown in Fig 7 5a? 

Clearly we can regard this function as the sum of the two translated step functions shown 

in Fig 7 56 Hence its equation is 

u(t — a) — uit — b) 
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FIGURE 7.3 
Plot showing how 
two step func¬ 
tions can be 
combined to give 
a rectangular 
pulse, or “filter 
function." 


AO 



I 


;(o 


jI 


/' 



I 


(W 


Although the function shown in Fig 7 5o is not ordinarily given a name, it could appropriately 
be referred to as a filter function. P’or when any other function is multiplied by this “filter func¬ 
tion" it is annihilated completely, le, reduced identically to zero, outside the “pass band," 
a < t < b, and reproduced without any change whatsoever for values of t within the “pass 
band " 


EXAMPLE 6 

What IS the equation of the function whose graph is shown m Fig 7 

FIGURE 7.6 y 

A graph con¬ 
sisting of 

straight-line i ■ 

segments 


To obtain the segment of this function between 1 and 2 we must multiply the expression 
2(£ — 1) by a factor which will be zero to the left of 1, unity between 1 and 2, and zero to the 
right of 2 By Example 5, such a function is u(t — 1) — u(l — 2) Hence 

2(< - l)[u(/ - 1) - u{t - 2)1 

defines the given function between I and 2 and vanishes elsewhere Similarly 
( — t -f 4)[u(< — 2) — u(i — 4)1 

defines the given function between 2 and 4 and vanishes elsewhere The complete representation 
of the function is therefore 

2(f - l)[w(f - 1) - u(t - 2)1 -b (-i + 4)lwa - 2) - u(t - 4)1 

- 2(t - l)y(l - 1) - :i(i - 2)u(t ~ 2) + (t - 4)u(t - 4) 

The transforms of functions that have been translated and 
cut off are given by the so-called second shifting theorem: 



THEOREM 6 

£lf(t — a)u(t — a)} = c"®*£{/(0t a ^ 0 

PROOF To prove this, we have by definition 

£lf(t — a)u(t — Jq /(^ ~ a)u(t — a)e~‘* dt ~ dt 

since the integration effectively commences not at / = 0 but at f = a because 
f(i — a)u(t — a) vanishes identically to the left of this point Now let f — a = T, 
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dt =■- dT. Then the last integral becomes 

dT = dT = e"®'£(/(0) as asserted. 

Before Theorem 6 can be applied, it is necessary that the 
function being transformed be expressed in terms of the binomial 
argument t — a which appears in the unit step function This 
will not often be the case, so it will frequently be necessary to 
alter the form of the function, as originally given, before it can 
be transformed In many cases this can be done by inspectK n 
On the other hwnd, we can always jiroceed in the following gen¬ 
eral way Supjiose we wish to transform 

- a) 

As it stands, this cannot be handled t>y Thr orem h, so we rewrite 
it in the foi m 

flu — a) -f a]iiU ~ a) = I'U — a)uU — a) 
where FU — a) — /[(/ — a) + a| = f(0, or FU) - fU fl) Now 
Theorem 0 can be appluai, and w(‘ have 
^\fU)uU — a)) = £|F(/ — a)v(t — a)) = r-°''£^\FU)\ = r “*£(/(/: -f- a)) 
Tlius we have (‘.stablished the following useful result. 

COROLLARY 1 

S^\f(t)uU - a)) = a) I 

As a tool for finding inveises, it is convenient to resl.ate 
Theorem G in the following form 

COROLLARY 2 

If J = /(/), then I = f(( — a)u{t — a) 

In words, this says that suj)p}essing (he factor e in a (ransforin 
y'eqmrcfi that the inverse of ivhal remains be translated a units to 
the right and cut off to the left of the point t = a 

EXAMPLE 7 

What IB the transform of the function Avhose grnjjh is shown in Fig 7 7? 

The equation of this function is obviously 

Pit) « -(ta - [U + 2)[wtt - 1) - u{t - 2)1 

- Mu it - 1) - 2) 

where f{t) “ — 3t + 2 However, the form of fit) is such that Theorem 6 cannot he applied 

\f(n 


fit)^ ~iF-^t+2) 



t 


FIGURE 7J 
A parabolic 
pulse 
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directly to either term m the expression for F{t) Hence we use Corollary 1, observing that 
fit + 1) - [(t -f n* - 3(/ -h 1) 4- 21 - t 
and fit + 2) - ((< 4 2)» - 3^ 4- 2) 4- 2] - -b « 

The required transform is, therefore, 

i„ _ <1 + + 2) 


EXAMPLE 8 

Find the solution of the equation //' 4 3j/ 4- 2 ^ y dt = fit) for which ijn “ 1, if fit) is the 
function whose graph is shown in Fig 7 8 


Kt) 


FIGURE 7.B I ! 

A rectangular 

pulse j 

i 1 

' I 

In this case/(O “ 2n(( - 1) — 2u(f 

y’ + ^ 


Taking transforms, wc have 


- 2), and thus the difTerential equation can be written 
2m(< - 1) - 2uii - 2) 


(flAilv! - 1) -f 3£{//| 4 - £(«/! 


2c " _ 2^>-»; 
s .s 


or 


(«* 4 38 4 2)£{f/| = 2f-* - 2p-** 4 8 


and 


£|J/1 


4 


2c- 


^8 4 1)(8 4 2) is 4 i)(.^ 4- 2) 


The first term can be w ritten 


2c-s* 

(.s 4 l)(s 4 2) 


2 _1_ 

842 841 

Hence its inverse is 2c“*‘ — If the exponential factors are suppressed in the second and third 
terms of £|t/), the algebraic portion w'^hich remains can be written 

_1_1_ 

8 + 1 8 4 2 

and the mverse of this is 2e"‘ — 2c-*' However, because the factors e"* and e"*" were neglected, 
it IS necessary to take the last expression, translate it one unit to the right and cut it off to the 
left of / “ ], and also translate it two units to the right and cut it off to the left of f — 2 in order 
to obtain the inverses of the original terras This gives for y 

y « (2^-i‘ - e-‘) 4 - 1) - 2(c-('-*J - - 2) 

Plots of these three terms, as well os of their sum, that is, y itself, are shown in Fig. 7 9 

We have already made repeated use of Theorems 2 and 3 
of Sec 7.2 on the transforms of derivatives and integrals On 
the other hand, it is sometimes convenient or necessary to con¬ 
sider the derivatives and integrals of transforms. The basis for 
this is contained in the next two theorems. 
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I 


FIGURE 7.9 L- - 

Plot showing the I 

solution 01 

Example 8 ^ j 

I 




THEOREM 7 

If f{t) IS f)iecc*wise regular and of exponential order and if Je|/(01 = then 

£|</a)l = 

PROOF By definition we have 

= fg f(t)e—‘dt = 

and, differentiating this with respect to s, we obtain 

Now under our usual assumptions that/(/) is piecewise regular and of exponential 
order, the product tf{l) also satislies these conditions Hence, by Theorem 6, 
Sec 7.1, the integral which results when £|/(/)) is differentiated partially with 
respect to s, namely, 

-tf{t)e-'dl 

converges uniformly Therefore, according to Theorem 3, Sec 7.1, the integral 
for £ 1/(0 I t^an legitimately be differentiated with respect to s inside the integral 
sign Thus, performing the differentiation, we have 

mi-le-“]dl 

or \lf{t)]e-“ dt = £\if{l)] = —^'(«) as asserted. 

By taking inverses in the assertion of Theorem 7 and then 
solving for/(0, we obtain the following useful result: 




853 


THE LAFUCE TRANSFOEMATION 


CHA8. 7 


COROLLARY 1 

lf£(/(0| = 0(s), then/(0 sje-M </>(«)! = - (1/0£“M) • 

This is often helpful when the inverse of a transform cannot 
conveniently be found but the inverse of the derivative of the 
transform is known The extension of Theorem 7 and its corol¬ 
lary to repeated differentiation of transforms is obvious. 


THEOREM 8 


If f{t) is piecewise regular and of exponential order, if £l/(01 = and if 

has a limit as t approaches zero from the right, then 



PROOF By definition 

4,{s) =£{m\ = me-“di 
Hence, integrating from s to «^ we obtain 

// = f‘ [fj me-•'dl]d, 


Now under the iisBurnptioti that hm exists and that fit) itself is piecewise 

h v0+ t 

regular and of exponential older, it follows from Theorems 6 and 2, Sec. 7 1, 
that the uitegration with respect to s can be performed inside the integral sign, 
i e., that the order of integration in the repeated integral can be reversed Hence, 
performing the integration, 


^ d>(s) di = ” <is dl 



/.■/«> 



dt 


as asserted 


By taking inverses in the assertion of Theorem 8 and then 
solving for /(/), we obtain the following vcsiilt 


COROLLARY 1 

If £ 1/(01 =-■ then m ^ I <<>(») 1 = t£- ‘ <t>{e) dsj 

This is often useful in finding inverses when the integral of a 
transform is simpler to work with than the transform itself 
The extension of Theorem 8 and its corollary to repeated integra¬ 
tion of transforms is immediate 


EXAMPLE 9 

What IB JCU* Bin 2t]? 

Bv a repeated application of Theorem 7, we have 


£(<■ Bin 2t\ 




12«* - 16 
(s> + 4)» 
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EXAMPLE 10 


What 18 1 / if JElyj — In [(« + !)/(« — 1)1? 

Using Corollary 1 of Theorem 7, we have immediately 


y - 





fi + 1 



c~‘ — _ 2 smh t 

__ ■ _ 


EXAMPLE 11 


What i8£((Hin kf)/i]? 

By Theorem 8, we have 

i sm kl\ 

-i 


/■ 


£(sm kt\ ds 


-j: 


-- ds - Tan~» - 

+ /c* k 


« - — Tan~> - — Cof^ 
2 k 


EXAMPLE 12 

W hat 18 y if £( 2 /) « — 1)*^ 

Using Corollary 1 of Theorem 8, wc have immediately 



t i 8inh t 

- (<•' - <■-') “ ----- 


EXERCISES 

Find the Laplace transform of each of the follow mg functions 


1 u(t — a) 

8 Ou(t - 2) 

6 e*‘u(l - 1) 

9 Sec Fig 7 10 


FIGURE 7 10 


FIGURE 7.11 


0 < i < TT 
r <. t 


\!i() 


/('I 


2 cos {t - l)u{t - 1) 

4 (f> - - 1) 

6 cos 'St vit — 3) 

o r/A I ^ 0 <t < 2 

® “ ( 2 2 < t y 

10 See Fig 7 11 / 


i , 


11 


1 — cos 3i 


13 


e« - 1 


?f* I (k 
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28 Bin 2t 


f* t sin 2t di 

Jo 


e~** am 2i 


14 t e~** Bin 2t 

16 Bin 2t i 

/'<8in2e 

18 c •* / - c 

Jo t 


rt ^ — cos 21 
Jo ~t 


Find the inverse of each of the following transforms • 


(® + 2y 

s + 1 

9a* -|- 6a + 5 
1 

*■(« + 1) 


»(• + 2)* 


(» + !)(»» +28 + 5) 


(• + !)• 

8 '4' a 


(a - l)(a - 2) 

a* - 1 
32 In- 


88 iXi -— 

9(8 + 1) 

SB ixan-'i 


84 a In-- -H 2 

a + 1 

86 Tauh-> ~ 


(a* + 4a + 5)* 


(a» + 3a + 2)* 


89 --- (Hint. Multiply and divide the transform by a ) 

(s’ + 1)’ 

40 Find the values of /(O'*') and of lim /(I), if it exists, if £(/(0 1 is 


s’ + 1 

® a* -h 68* + 113-1-6 
^ a> - a* + 2 

41 Show that, under appropriate conditions, 


28* - 38^ - 28 

_ 3 4- 2 

8> + 3a* +~48 + 2 


and that 


hm 3la£l/(0) ~/(0+)] «/'(0^) 


hm s[a*£(/(0) - a/(0+) - f (0-^)1 - T(0+) 


What conditions beyond those of Theorem I are necessary for the validity of these results? 
Can the value of he obtained by an extension of these formulas? 

42 Show that, under appropriate conditions, 

hm ala£l/(0) -/(0+)l - lim/'(O 

»-»0 t-»«o 

What Cipnditions beyond those of Theorem 2 are necessary for the vaUdity of this result? 
CbAthis result be generalized to the determination of hm from £1/(0)? 
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Solve the following differential equatione. 


48 

v" 

+ 4v' 

+ 3y 


e-** 


Vo 

/ 

- yo 

- 

1 

44 

v" 

+ 4y 

- C 08 

2t 



Vo 

. _ 

2, 

Vo - 1 

46 

y" 

4-3y' 

+ 2y 

- 

uit 

- 1) 

yo 

“0, 

Vo 

- 1 

46 

y” 

+ 4y' 

-h 4y 

- 

it - 

■ 2)e-<‘-«)u(( - 2) 

Vo 

- 1 , 

Vo 

- -1 

47 

y'^ 

+ 2y- 

+ y 

- 

0 


Vo 

- Vo 

- 

1 

p 

1 


48 Prove Theorem 1 without aseuming that /(t) is continuous. (Hmt- Use the result of Exer¬ 
cise 3, Sec 7 2.) 

49 Prove Theorem 2 without assuming that/(0 is continuous (Hint: Use the result of Exer¬ 
cise 3, Sec 7 2 ) 

60 Where in the proof of Theorem 2 is use made of the hypothesis that the abscissa of con¬ 
vergence of fit) IS negative? 


7.5 


The Heaviside expansion theorems 

The frequent use we have had to make of partial fractions indi¬ 
cates clearly the importance of this techmque m operational 
calculus It is therefore highly desirable to have the procedure 
systematized as much as possible The following theorems, 
usuallv associated with the name of Heaviside, are of great utility 
in this connection: 


THEOREM 1 

1^/(0 = ^ where p{s) and q(s) are polynomials and the degree of 

q(ii) IS greater than the degree of p(«), then the term in fit) corresponding to an 
unrepcated linear factor s — a of qis) is 

^ or equally well 

q'{a) ^ ^ Qia) 

where Q{s) is the product of all the factors of qis) except s — a 


PROOF In the familiar partial-fraction decomposition of pis)/qis), an un¬ 
repeated linear factor 5 — a of qis) gives rise to a single fraction of the form 
A/is — a) Hence, if we denote by his) the sum of the fractions corresponding 
to all the other factors of qis), we can write 


Pjs) 

qis) 


+ h(s) 

s — a 


where, since s — a is an unrepeated factor of qis), his) remains finite as s ap¬ 
proaches a Multiplying this identity by s — a then gives 


{s - o)p(« ) 
?(s) 


p(») 

g(s)/(s - a) 


= A + (s — a)ft(a) 


If we now let s approach a, the second term in the nght member vanishes, and 
we have 


A = lim 


p(s) 

5(4)/(» - a) 


THE UPLACE TltANSPOEMAHON 


CHAP. 7 


tu 


The limit of the numerator here is evidently p{a). The denominator appears as 
an indeterminate of the form 0/0. However, if we evaluate it as usual according 
to L’Hospitars rule by differentiating numerator and denominator and then 
letting 8 approach o, we obtain just q'ia). Hence 



On the other hand, we could have eliminated the indeterminacy before passing 
to the limit simply by canceling s — a into g(s), which by hypothesis contains 
this factor Doing this, we obtain the equivalent form of A . 


A 


via) 

Qia) 


Finally, taking inverses, it is clear that the fraction A/(s — a) gives rise to the 
term 


= 


p(o) 

9'(a)' 


Q{«) 


in the inverse/(O, as asserted. 


If qis) contains only unrepeated linear factors, then hy 
applying Theorem 1 to each factor m turn, we obtain the follow¬ 
ing useful result 


COROLLARY 1 

If f(t) = 1 if q(s) 18 completely factorable into unrepeated 

linear factors 

is - tti), (s - Qz), . . . , is - an) 

then 


where Qiis) is the product of all the factors of q(8) except the factor s — a. 


TH EOREM 2 

If/(<) = £-Mp(«)/<?(«)!, where p(s) and q{s) are polynomials and the degree of 
g(«) IB greater than the degree of p(s), then the terms in /(() corresponding to a 
repeated linear factor (s — a)' in ?(«) are 


_("-1: 


^o) 

1 )! 


+ 




+ 


+ 


0'(a) 


^L-2)! + 


(r - 2)! II ' ’1! 

where (^(«) is the (luotieiit of pis) and all the factors of q{s) except (s 


r-* 

- l)!j' 


a)^ 


PROOF From the familiar theory of partial fractions we recall that a repeated 
linear factor (s — a)'' of g(5) gives rise to the component fractions 


A1 I A 2 I ^ , A f—1 I A r 

5 — a (s “ a)* {s — (s — a)'^ 

If we let h{s) denote, as before, the sum of the fractions corresponding to all the 
other factors of g(«), we have 


pW > 4»is) 

qia) ^ (fi - a)-^ 



(s - a)* 


4- 


■ + 


_ Ar-l I _ Ar 

{a — a)'~^ {a — a)’’ 


4" hia) 
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Multiplying this identity by (s — o)’’ gives 

= Ai(8 - 0)^-1 -f Aiis - -h • • • + Ar^iCs -a) A-Ar+ (s- a)^/i(s) 
If we put 5 = o in this expression, we obtain 
4>(a) = Ar 

If we now differentiate we have 

= Ai(r - l)(s - a )-2 - 2)(s - + • ■ • 

H- ilr_i -f r(fi — ay~^h(8) {s — ayh'is) 

Again setting s = a, we find this time 
if>'(a) = Ar-i 

Continuing in this fashion, noting that the first r — 1 derivatives of the product 
(5 — ayh{a) wiU all vanish when 5 = a, we obtain successively 

</>"(a) = 2!A._2 
0'"(a) = 3!A,_3 


0 (-i)(a) = (r - l)!Ai 


A; = 0 , 1 , 


,r- 1 


The terms in the expansion of p(s)/g(s) which correspond to the factor (s — a)' 
are, therefore, 

(a) 1 . 0"-«(a) 


(r - 1)1 8 - a (7- 2)V (s - o)» 


1 


+ 


I ^ I Jl'n'l ’ 

■'■“rr (TTTSpi + ^(«) 


(s - ay 


Recalling that 




1 


(s - a)' 


r-'e" 


(n - 1)1 

it IB evident that the terms in y which arise from these fractions arc 

4>'{a) 


“(a) _a, I (a) 1 

(r - 1)! (r - 2)1 II 


+ 


1! 


(r - 2)1 (r -'1)1 


If we factor out from this expression, w^o have precisely the assertion of the 
theorem 


THEOREM 3 

If/(O = £"MpW/g(s)l, where p(s) and qia) are polynomials and the degree of 
g(s) IS greater than the degree of p(s), then the terms in }{t) which correspond 
to an unrepeated, irreducible quadratic factor (s -|- a)® -j- 6^ of qis) are 
6— 

COB hi + 4^r sin hi) 

where <l>r and are, respectively, the real and imaginary parts of ^( —a -j- ib), 
and </>(s) is the quotient of p(s) and all the factors of q(8) except the factor 
(fl + a)» -f b\ 


THI UPUCE TKANSPORMATION 


CHAP. 7 


3St 


PROOF From the familiar theory of partial fractions we recall that an unre¬ 
peated, irreducible quadratic factor (s -|- a)* -f 5^ of q{s) gives rise to a single 
fraction of the form 


As + B 

(s -h ay + 


in the partial-fraction expansion of p(s)/g(a) If again we let h{8) denote the 
fractions corresponding to all the other factors of g(a), we can, therefore, write 


pis) 

qis) 


_ 4>(s) 

(s -h a)^ + 


As -|- B 


+ h(s) 


Multiplying this identity by (s -1- a)* + b^, we obtain 


= As -f + [(s + a)2 -h h^Ms) 

Now put s = —a-\-ib This value, of course, makes (s + a)^ -f vanish, hence 
the last product drops out, leaving 


<t>{ — a-\-tb) = ( —a + lb)A -\- B 


or, reducing ^( —a -h ih) to its standard compilex form 4>r -1- 
<t>r "1“ ~ (— ^A -|- B) “h lb A 


Equating real and imaginary terms in the last identity, we find 


</>r = —aA B = 6A 


or, solving for A and B, 



15 60 r H- 


Thus the partial fraction which (corresponds to the quadratic factor {s + a)* -h ft’* 

IS 

As B _ 1 <^.5-1- {b4>r -f a4>,) 

(s + ay^ -y ' b (s + a)^'b'^ 

^ 1 r (g + 0) </), _ b(t>r _ 

6 (_(s + a)2 -h (s -f a)2 -P 6* 

The inverse of this expiression is evidently 

" cos bt -f 8in bt) 

Factoring out now gives the assertion of the theorem 

There is a fourth theorem dealing with replicated, irreducible 
quadratic factors, but, because of its complexity and limited 
usefulness, we shall not develop) it here Fortunately, many of 
the simpler transforms involving repeated quadratic factors can 
be handled by otlier means, for instance, the convolution theorem 
of Sec. 7 7. 


EXAMPLE 1 

If JCl/) » (8* + 2)/«{.s -I- 1)(5 + 2), what 18 /(f)? 

Th#,''rootR of the denominator are s = 0, — —2 Hence we muat compute the values of 

p(s) " a* + 2 and q'{s) — 3«* -H Os -f 2 
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for these values of s The results are 

p(0)-2 p(-l)»3 p(-2)-6 

7 '( 0)-2 g '(- i ) -= -1 9 '(- 2)-2 

From the corollary of Theorem 1 we now have at once 

fit) = ? c®* -h e-' 4- ^ e-*' - 1 - 3c-‘ + 

Equally well, of course, we could have obtained the coefficients in the inverse by suppressing 
each of the factors in turn and evaluating the rest of the fraction at the root associated with the 
suppressed factor 


EXAMPLE 2 

If £(i/) “ 8/is -f 2)*(«* 4- 2s -}- 10), what is y? 

Considering first the repeated linear factor, we identify 


<t>is) 


and 


•'(«) 


s* + 2 s + 10 
Evaluating these for the root s = - 2, we obtain 

<^(-2) = and •#»'(-2) = Ho 

Hence, by Theorem 2, the terms in y corresponding to (s -f- 2)* are 

(3 - 10f)c-*‘ 


_-K* + to 

27+10)'a 


'-(l-i) 


.')0 


For the quadratic factor s* + 2s 4 10 = (& + I)* -1 V, we liave 
8 

(h(s) = - - 

^ (S' + 2)* 

Hence, 

0(~ o + 1^) = <#»( — ! + 3?) 


-1 H .b 


-1 f 3i - 1 13 -_9i 

|(-1 + 3i) + 21* n + 3i)* -H 4^6t 50 


and thus 4>r = ^Ho, = ~%q Tlie term in y corresjiondiiip to th(‘ factor 

5 * + 25 + 10 

( — 9 cos 3< 4 13 sin 'M) 


18 , therefore, 


1 f e"‘(-9 ( 
3 


50 


Adding the two partial inverses, we have finally 

(3 — l(M)e e“'( ~9 cos 3f 4 13 sin 3f) 


50 


150 


EXERCISES 

Find the functions which have the following transforms 


.s* — 8 4 3 

7’4 11.74 6 

5 

rs~4~^(7'4T) 

8+2 

7~T47 -b 4«*~48717 


2 

4 

6 


5+2 

(s' 4 \)i8^4) 

s 4 1_ 

(8* 4 l)(a* 4- 4a'7 13) 
8 

(a 4 1)(« -f 2)» 
a 4 2 


- 28* 4 1 


6 


8* - 16«* 4 100 
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Solve the following differential equations' 


9 

u'" 

- 2y" 

- 

y' 4- 2v - 

u(t - 2) 


yo - yi » 

0 , Vo 

- 1 

10 

V'" 

+ 3y" 

+ 

3v' 4- y - 

cosh 1 


1 

1 

y'o' - 

0 

11 


+ 2y" 

' 4 

2y" 4 - 2y' 

’ + y “ c' 

-t 

H 

1 

I/O - 

yo - 0 

12 

x" 

4 2i' 

-b 

r V d< - 

t \ 









Jo 

? Xo 

SB _ 

-1, lo “ 1 




Ax" 

— 5x' 

+ 

y » sin 21 

) 





18 

(D> 

4 D 
4- 2D 

4 

+ 

l)x + {D - 

3)z + (3/)> + 4D - 

1 )V 

3)y 

- u{t) 

“ u(i — 1) 

1 

3^0 " ^0 


14 y' - - 5 

y + z' — w " 3 — 2< Vo " 1, “ 0, too — — 1 

z -1- ly' — — 1 


16 In the proof of Theorem 3, verify that, if the identity 
^(8) - + B -h [(8 + a)* + h^]h{8) 

IS evaluated for a * — o — tb instead of for « “ — a + ^b, the same inverse is obtained 


7.6 

Transformi of periodic functions 

Tlie application of the Laplace transformation to the important 
case of general periodic functions is based upon the following 
theorem 


THEOREM 1 


If f(0 is a ])iecewise regular function of exponential older which is periodic with 
period a, then 


£tf(0} = 


j° f{l)er“dt 


PROOF By definition, 

£|/( 0 ) = mer“dt 

= l"f«)e-'dt 4- j^'‘me->dl + ll“me^“dt 4 

Now, in the second integral, let i - T -\- a, in the third integial let t = T -f 2a; 
and in general let t = T na in the (n -f l)st integral In each case dt = dT, 
and the new limits become 0 and a Hence 

£|/(01 = 1° dr + IJ f{T + dT 

4 l‘f(r 4 dT 4 • 

= l°f{T)e-^dT 4 «-“* f°f{r 4 a)e~-^dT 

4 e-’" jJfiT 4 2a)e-^dT 4 • ■ 

But f{T -b a) = f(T H- 2a) = = f{T -}- na) = = f(T) for all values 
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of T, since, by hypothesis, j{i) is of period a Thus we have 

JC 1 m 1 = /„“ f{T)e-’^ dT + e -- f(r)e-^ dT + e-»«' f{T)e-^ dT + • 

= (1 + e-“' + e-*- + ) lJfiT)e-^dT 

Now, if the infinite geometric progression which multiplies the integral is 
explicitly summed, using the familiar formula S = 1/(1 — r), where the com¬ 
mon ratio r is we obtain the result of the theorem. 

EXAMPLE 1 

Find the traneform of the rectangular wave ehow'n in Fig 7 12 

FIGURE 7 12 
An alternating 
rectangular 
wave 


The [leriod here ifl 2b Hence by Theorem 1, 

£1/(01 ~ 

1 1 - _ _(1 - _ 

“ 1 - ” «(1 - + e -**) 

1 _ p~h, _ g-6./S 1 1)8 

—-- = — --=» tanh — 

s(l + <;-'»•) i 2 


Id) 



EXAMPLE 2 

Find the transform of the saw-tooth wave shown in Fig. 7 l.S 
Here the period is k, and thus 


irk if 1* 

£ 1/(01 - —I te -'dl - - (St - 1 ) 

1 - (1 + (1 -b ks) — (1 + fca)e~** - ka 


«*(1 - 
1 + fcs 


gi(l _ p-*.) 


s(l 


FIGURE 7 13 
A saw-tooth 
wave 
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EXAMPLE 3 

Whet IS the Laplace transform of the Btaircaee function 

f(t) “n + l nk < t < (n -h l)k n =» 0, 1, 2, 


shown in Fig 7 14o7 


FIGURE 7.U 

The "staircase 
function" and its 
synthesis. 

(a) 




The required transform can easily be found by direct calculation, However, it is even simpler 
to obtain it by considering fit) to be the difference of the two functions shown in Fig 7 iib 
The transform of the linear function {t + k)/k can be found at once by Formula 4, See 7,3 
Except foi the obvious coefficient \/k, the transform of the saw-tooth function w'a,y obtained 
in the last example Hence, 


£ 1/(01 


1 / 1 fc\ 1 /l -f its k \ 1 

k \8* s J k\ 8* .s(l — c”**) J .s(l — e“**) 


EXAMPLE 4 

If the Laplace transform of f{l) is l/((8 + a)(l — <;“**) 1, what is f(t)? 

Although i!{/(<j) resembles somewhat the transform of the staircase function obtained in 
the last example, the correspondence is not sutliciently close to provide us with the required 
inverse Moreover, we cannot successfully employ the result of the last example after first using 
the corollary of Theorem 5, Sec 7 4, for if we replace 8 by .s — a, the given transform becomes 


1 


1 


s[l - 


8[1 — c“‘e **| 


and now, because of the factor c"*, w'hjch is not equal to I except in the trivial cases a = 0 or 
k «= 0, we still do not have the transform of the staircase function It appears, therefore, that 
WM‘ muHt make a direct attack upon the problem To do this, lei us reverse the derivation of 
Theorem 1 and replace 1/(1 — c"**) by the infinite geometric seric.s of wdiich it is the sum 


£ 1/(0 I 


1 

(s + a)(l — c“**) 


—— (1 -h e"*' -f c'2** -f -f 
8 + n 


) 


Now let us assume that we can take the inverse of this infinite series term by term If we neglect 
the exponential m, say, the (n -f l)8t term, the inverse of wdiat remains is obvious, namely, 




But, having neglected the exponential we must, according to Corollary 2 of Theorem fi. 

Sec 7 4, translate the function e~ to the right a distance of nk and then cut it off to the left of 
t “ nk When this is done for each term, we have 

fit) - f-a* _|_ - k) - 2k) + _ ^k) + 

Taking into account the "cutoff" properties of the various translated step functions, it is thus 
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clear that the function f{i) is equal to 

c"“‘ over the interval {Q,k) 

e"“‘ -f over the interval (k,2k) 

c““* + -I- over the interval (2k,3k) 


g-at -|_ gakg-al ^ g«ofcg-«l -j- -|- gnakg-al thc mtcrval [uk, (u + 1)A] 


In order to obtain a more convenient expression for f(t) over the general interval 
nk < t < (n ])k, we can sum the finite geometric progression defining f(t) in this range 
Since this progression contains n -b 1 terms and has the common ratio r — e“*, it follows iliat 
over this interval we have 


m = 4- 4- 


4- e"“*) 


(f.a*)n+* _ 1 

gafc _ I 


g-all—(n + l)k] g—ot 

gak _ 1 «“* — 1 


nk < i < (n \ )k 


Now, to achieve a more Hyrnmetnc form, let us define t / — (n 4- DA: Clearly, t ™ nk corre¬ 
sponds to T ■= ~k and 1 = (n 4- DA: corresponds to t == 0, so that, for each value of n, the 
parameter t ranges from —A; to 0 as i ranges from nk to (n 4- 1 )k If we make this substitution 
in the first fraction only, f(t) assumes the form 

fit) “ —----— —k < T < 0, nk < I < (n l)k 

gak _ ] - 1 



FIGURE 7.]5 
Plot showing the 
inverse of 
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Th^ second term is a continuoua function, dying away rapidly as t increases if a > 0 The first 
term is completely independent of n, that is, yields the same set of values over each interval, 
because no matter what n may be, as t ranges from nk to (n + l)k,T always ranges from —A- to 0 
Moreover, the first term is discontinuous, since at the left end of any interval, where t — — fc, 
its value IB 

- 1 

while at the nght end, where t ■» 0, its value is 

__i _ 

pafc _ I 

The periodic function it represents has, therefore, a jump of 

6“* I 

^-1 ” - 1 " 

at each of the points t — k, 2k, ‘6k, 

In Fig 7 15 the discontinuous periodic function represented by the first term in /(<), the 
continuous transient term represented by the second fraction, and /(<) itself are shown for 
a ^ and fc - 2 


EXAMPLE j 

What is the solution of the equation y' -h 3y + 2 ^ ty dl * /(t) if yo == 1 and if J{t) is the func¬ 
tion shown in Fig 7 16? 

|;u) 

FIGURE 7 16 
A saw-tooth 
wave 


Taking the transform of each side of the given equation, using the result of Example 2 to 
transform f{i), we have 

(.£lwl - 1) +3 jE1i,I +-£|yl - —T 

8 8* s(l — r~*) 

or £ 1,1 _>_ 

«(» + !)(* +2) (» + l)(s +2)(1 - e-') 

The inverse of the first fraction can be found imrnediatelv by the corollary of the first 
Heaviside theorem. 

H - f"' + 

To find the inverse of the second fraction we must write 



(8 -f 1 )(« + 2)(1 - 8 


- -f-i_i-V 

'*) \S + 1 8+2/ 


(8 + 1)(1 - €-•) (8 + 2)(1 - e -«) 


and then use the results of Example 4 In this case fc — 1, and thus the mverse over the general 
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interval n<i<n-}“lis 



The second term is obviously a continuous function of i and is simply an additional contribution 
to the transient of the system The periodic function defined by the first term is also continuous 
in this case, because the unit jumps exhibited by each of the fractions at i * 1, 2, 3, are 

of opposite sign and, hence, cancel each other. The entire solution for y is therefore 



transient stead v'-state 


-1 < r < 0 


Fif^ure 7 17 shows a plot of the component terms and (A y itself 

The analysis of equations like tho one considered in Exam¬ 
ple 5 is so important that a table of additional results similar 
to that obtained m Example t would be liighly desirable. Using 



FIGURE 7.17 
Plot showing the 
solution of 
Example 5 
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for the most part only the procedure illustrated in Example 4, 
such a table can easily be devclojied, as we shall now show 

To eliminate unnecessary writing, it will be convenient to 
introduce the functions defined in Table 7 1 for the interval 
nk < X < (n \)ky where k is an arbitrary positive number, 
n is an arbitrary norinegative integer, and x is a variable which 
IS to be replaced by t or t, as required The functions (t>i{x,k) and 
<t>i(x,k) are, respectively, the staircase function and (he Morse 
dot function. The functions <i>.i(x,k) and 4 > 4 ix,h) are the integrals 
from 0 to x of 0i(i,A:) and resfiectively The function 

4>i(Xya,k) is precisely that which we encountered in the solution of 
Example 4 The others, though somewhat more complicated, 
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arise in the same way and can be plotted just as easily when the 
parameters a, 6, and k are known 

Table 7.2 lists the inverses of all elementary periodic-type 
transforms which are likely to be encountered. Of course, as 
Example 5 illustrated, it is usually necessary to employ the 
method of partial fractions before the results of Table 7 2 can 
be applied 

tablo 7.2 


Inverse over general interval 
Laplace transform nk < t < {n i)k 

-k < T <0 



4n{t,k) 

<i>2{t,k) 

Ml,k) 

) 

^ Mt,a,k) 

07(T,a,/>,/c) — 

{ — -f <i>bi(,a,h,k)X 

tp9iT,a,b,k) — <i)g{i,a,b,k)'\ 

( —+ 4>\(,{t,(iJj,k)X 

( —l)"0is(T,a,A;) H- 4>i2(t,a,k) 


t The possibility that, simultaneously, a is zero anil bk is an even multiple 
of IT is to be ruled out 

t The possibility that, simultaneously, a is zero and bk is an odd multiple 
of T 18 to be ruled out. 
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Formulas 1 to 4 are obtained by obvious applications of 
Theorem 1 and of Theorem 3, Sec. 7.2. Formula 5 was derived 
in detail in Example 4, and the derivations of Formulas 6 to 10 
follow almost exactly the same pattern All that is necessary is 
to express as complex exponentials the sines and cosines which 
appear in the inverses of the individual terms The expression 
for/(/) over any interval nk < t < {n l)k is then, as in Exam¬ 
ple 4, just a finite geometric progression which can be summed 
and converted to a purely real form without difficulty 

The derivation of Formulas 11 and 12 are somewhat different 
because of the repeated factors in the denominators of the trans¬ 
forms. Over the general interval nk < t < (n l)k, these lead 
to expressions for /(/) which are series of the form 

j -0 j -0 j -0 

in the case of Formula 11, and 

»i n n 

y = if’'""' y y 

j-0 j-0 j-o 

in the case of Formula 12 In each instance, the second senes is 
not a geometric progres.sion and must be summed by other 
iiicuns I'Virtunatcly, (lie ri'sults of Exam])le 3, Sec 4.5, are a]>pli- 
cable, and through their us(‘ the inverHcs given in Table 7 2 can 
easily be established. 

The transient, or /-evaluated, terms in the inverses m Table 
7 2 are all continuous for all / ^ 0 This is true of the jicnodic, 
or T-evaluated, terms if and only if the degree of the polynomial 
part of the denominator of the transform exceeds the degree 
of the numerator by more than 1 If this is not the case, there is a 
jump of 1 at each of the points / = A, 2k, 3A., , nk, if 

the denominator of the transform contains 1 — c"** and a jump 
of ( — 1)" if the denominator of the transfoim contains 1 4- 


EXAMPLE 6 

A simple senes circuit contains the elements U *= 400, L * 0 2, T =5 10~* At i = 0, while the 
circuit iR completely passive, an exponential “Raw-tooth’' voltage w^ave, equal to 
throughout one period and repeatiriR itself every 0 002 sec, is switched into the circuit Find the 
total current and also the steady-state current which result 
The difTerential equation to he solved is 

02^4 400i 4 10« f\dt ~ E{t) 

(it Jo 


Takinp the Laplace transform of botli sides, we obtain 

r 0.002 




/ loA 

( 0 2« 4- 400 H-j 


r 




■y _ g-o 001* 


- (« -h ^ 


OOO) 

s’ooo) J, 
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, *• + 2,000«-i- 5 X 10« „ 1 - c-“ 

JClil-- Eq - 

5a (a + 5,000) (1 - e-® o®**) 

(1 - +a->°(l - c-"®”*) 

" (7+ 5,000) (i - e-® ®»**) 

" a -h 5,000 (a + 5,000) (1 - e"® »«*•) 


£ {I j s —--- 

(a + 5,000)[(a h 1,000)> + (2,000)*] 


_ bEf>{\ - e-^®)8 _ 

(a 4- 5,000)[(a -h 1,000)* + (2,(K)0)*](1 - e"® °®*') 


Now by Bimplti partial-fraction manipulationB wc 6nd 


_ ' _ 1_ _a -f- 1,000 

00 ' r+5^000 (7~4T.rKX))’^+ (2,000)* 


(s -b 5,000)1(8 + 1,000)* -b (2,0(X))*] 4,000 |_ « + 5,0C 

From this point the entire solution can be written down at once 


--(_c-B.nooi 4-e-i.0001 pos 2,0000 

4,000 ^ ^ 


5Eo(l - e-‘®) 


[06 (t, 5,000, 0 002) - </)j(i, 5,000, 0 002)1 


-b “ ‘^t(^ 1 ,000, 2,000, 0 002)1 


The steady-state current is described by the terms m t 

5 000 , 0 002 ) - 07 ( r , 1 , 000 , 2,000 0 002)1 

4,000 ^ ’ 

or written out at length' 

/;o(l -- e-i®) [ e'® ®®®^ e-‘-®®®^cos 2,000 (t -b 0 002) - cos 2,000r 

800 — 1 2(cosh 2 — COB 4) 

This function, plotted for —0 002 < r < 0, defines one complete cycle of the steady-state 
current Of course, the unit jumps m and 0? at the ends of each period just cancel, leaving 
the hteadv-state current continuous, as, of course, it must be 

The operational solution of a problem such as (his, leading as it does to a relatively simple, 
finite expression for the response, is in general to be preferred to the use of Fourier senes, which 
leaves the answer in the form of an infinite senes 


EXERCISES 

1 Using Theorem 1, verify that 

a Jiilsin = 5/(a* -f 5*) b £|co8 ht] - a/(a* -b 5") 

2 Obtain the Laplace transform of the slBircase function (Fig 7 14fl) by direct evaluation 
of the Laplace transform integral 

Find the Laplace transforms of the periodic functions whose definitions over one period are. 


8 fit) « Bin ( 0 < ( < T 


. «<>-{' 


0 < f < a 
a < i < 2o 


4 m - {‘ 



0 < t < IT 

ir < < < 2ir 

0 < / < a 
o < t < 2o 
2o < < < .3a 
3a < I < 4a 






THE LAEUCE TRANSFORMATION 


P4AP. 7 


Find the inverse of each of the following transforms; 


(8 + l)(s + 2)(«* + 1)(1 - 


e~* 

7(8^ H- 28 -f 5)(1 -f- €-•) 


(8 - n (8 -f 2)“(1 + e ~'>) 


10 


_ 38 + 5 _ 

(s + 1)(8^ + 48 + 5)(1 - p-*-') 


Solve the following differential equations and explain your answers, f{t) being in each 
case a periodic function defined over one period as indicated 


11 y' 3 f V (it = f(i) 

Jo 

12 y" + Ay' + 4y -= /(<) 

13 y" + y = m 


m - 1 

=i i 

m = { I 


0 <t <2 
•2 <t < A 
0 <t < \ 

I < t <2 

0 < t < IT 

IT < f < 2ir 


Vo - 1 
Vo = Vo = 0 
Vo " v'o = 0 


14 According to the footnotes to TaVde 7 2, certain values of a, h, and k cannot be allowed 
to occur simultaneously in Formulas 7, 8, 9, and 10 of Table 7 2 because the formulas 
become meaningless for these values Why is this? 


IB Derive each of the following formulas of Tabic 7 2 

k Formula 6 b Formula 7 c Formula 8 

d Formula 9 e Formula 10 f Formula 11 

g Formula 12 


7.7 


Convolufion and the Duhamel formulas 

We shall conclude this chapter by establishing a result concern¬ 
ing the product of transforms which is of considerable theoretical 
as well as practical interest 


THEOREM 1 

£l/WlJEtff(/)| = £ {/„'/(< - Mf/W 


PROOF Working with the term on the right in the first equality, we have 
by definition 


( 1 ) 

Now 


^ { 17^' ~ = /o" [ 17^' - 

( 0 XX 

f(i - x)a(x)u« - X) = j X < t 


and thus 
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Since this product vanishes for all values of X greater than t, the inner integration 
in (1) can be extended to infinity if the factor u(t — X) is inserted in the integrand. 
Hence, 

(2) = X* ~ M 

Now our usual assumptions about the functions we transform are sufficient to 
permit the order of integration in (2) to be interchanged' 

(3) £ {fit - )^)gi\) ~ ^^gWuit - \)e— rfi] d\ 

= X f X ~ 

Because of the presence of u(t — X), the integrand of the inner integral is identi¬ 
cally zero for all t < X Hence, the inner integration effectively starts not at 
I = 0, but at ^ = X Therefore 

(4) a { f‘ fit - X)g(\) </x} = X“ gW [ X* *] 

Now, in the inner integral on the right of (4), let t — \ — t and dt = dr 
Then £ { l‘ fit - \)g(X) rfx) = X* [ X" 

= X 

= [ X" [ X* 

= £ 1/(0 I £ I {7 (01 asserted 

From symmetiy, the second form of the theorem can be obtained by interchanging 
fit) and ^(0 

The convolution, or Faltung,* integral 

f fit - X)ff(X) d\ 

IS frequently denoted simply by /(0*.<7(0 fbis symbolism 
Theorem 1 becomes 

£\f\^{g\ = JC|/*<7| = 

EXAMPLE 1 

If£(/(0) - l/(.s2 -j 4.. + 1.3)*, what ir/( 0^ 
rieaify, we can \n rjte 4! 1 /"(O j in the form 

1/[(.S + 2)M 3T 

and then use the corollary of the first shifting theorem (Theorem .5, Sec 7 4) to obtain 



Cierman for folding 
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Hence, by tVie convolution theorem, 


£-1 


Therefore, from (5), 


-^- « 1 f^ain 3(f — X) sin 3X dX 

4- 3*)*I 9 yo 


9 J 

'o 

2 

1 

P Bin (6X 

-30 ^ 

18 

L « 


1 

/sin 3< 

t COB 

18 ' 



(sin — 

3f cos 3/) 

64 


This example illustrates how in certain cases the convolution theorem can be used in place 
of a fourth Heaviside theorem to handle repeated quadratic factors in the denominator of a 
transform 


EXAMPLE 2 

Find a particular mtegral of the differential equation 
y" + 2ay' (a* + ?)*)v “ /(<) 

Taking the Laplace transform of the given equation, assuming Vo “ “ 0, since we desire 

only a pariiciiiar solution, we find 




Now 

1 ^ Bin hi 

4 tt)> 4- 1 b 

Hence 

£|l/l - £1/(01 £ 1 

and thus, by the convolution theorem, 


W “ 1 f f(^ — X)e~“^ Bin 6X d\ 
b yO 

or, equally well, 

1 ft ^ ft 

j/ “ , / /(X)e~“<*“^) Bin b(l — X) dX — / /(X)c“^ sin b(t — X) dX 

0 yO b Jo 

It 18 interesting to compare this procedure with the method of variation of parameters 
(Sec 2 4) for the determination of particular integrals of linear differential equations The two 
give identical resultB in the case of constant-coefficient linear differential equations 

An especially important application of the convolution 
theorem makes it possible to determine the response of a system 
to a general excitation if its res})ori8e to a unit ste]) function is 
known To develop this idea we shall need the concepts of transfer 
function and mdictal admittance. 

. Any physical system capable of responding to an excitation 

can be thought of as a device by means of which an input function 
is transformed Itito an output function. If we assume that all 
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(0) 


(7) 


initial conditions are zero at the moment when a single excita¬ 
tion, or input, /(O begin.s to act, then, by setting up the differential 
equations describing the system, taking Laplace transforms, 
and solving for the transform of the output y{t), we obtain a 
relation of the form 


£( 2/(01 = 


£\m 

~Z{s) 


where Z{s) is a function of whose coefficients depend solely on 
the parameters of the system Moreover, in the usual applications 
to linear systems, Z(.s) will be just the quotient of two poly¬ 
nomials in s 

In electrical problems where the input is an applied voltage 
and the output is the resultant current, the function Z(s), 
except for the fact that the frequency variable is replaced by 
the Laplace transform parameter s, is just the impedance of the 
network However, the importance of Z(s) is not restricted to 
electrical circuits, and foi systems of all sorts the function 

1 _ _ £(output 1 

Z(s) Jelmputi 


is an exceedingly important quantity, usually called the transfer 
function. In particular, after s has been replaced by jee, the 
transfer function can be used to deteimine the effect of any sys¬ 
tem on the filiase and amplitude of a sinusoidal input of arbitrary 
frequency, just as in the electrical case 

If a unit step function is applied to a system wnth transfer 
function ]/Z(.s), then fiom ((>) we have 


£!v(/)l 


£[u(t}\ 


1 

.sZ(.) 


The response m this particular case is called the indicia! admit¬ 
tance A (t ); that is, 


£(^(01 = 


8Z{S) 


Using (7) we can now rewrite (6) in the form 

iiWOI - 

Hence, by the convolution theorem, 

£|!/(0I = s£{j^A(t- X)/(X) rfx} = SJE {^‘^(X)/a - X) rfx| 
But from Theorem 3, Sec 7.4, it follows that 


V(t) = I [/o' = Ji [M d\] 
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( 8 ) 

(9) 


( 10 ) 

( 11 ) 

( 12 ) 


FIGURE 7 18 

Plot showing the 
syrithpsiH of a 
gonrrnl function 
by men na of step 
functions 


Therefore, performing the indicated differentiations,* we have 
equivalently 

yd) = A'd - X)/(X) + A(0)/d) 

and 

yd) = fo ^ Wf'(t -\)d\ + A (0/(0) 

Since A{t) is by dehnition the response of a system which is 
initially ])assive, it follows that A(0) = 0 Hence, Eq (8) becomes 
simply 

yd) = /„' A'd - X)/(X) dX 

Finally, by making the change of variable r = / — \ in the 
integrals in (9) and (10), we obtain the related expressions 

!/(0 = Jq A'(T)f{f — t) (It 

y(t) - A(t)f{0) + A (t ~ t)/'(t) (It 

Formulas (9) to (12) all serve to express the response of a 
system 1o a general driving function f(l) m terms of the experi¬ 
mentally accessible resjKmse to a unit stej) function They are 
often referied to collectively as DuhameFs formulas, after the 
French mathematician J M (' Duhamel (1797 1872) 

It IS possible to interpret these integrals m physical terms 
as follows Let th(‘ driving function /(/) be given, and imagine 
it approMmated bv a series of step functions, as shown in l-'ig 
7 18 The first step function is of iiomnhnitesimal magnitude 



I 


* According to Leibnitz’s rule, if F(t) 


/: 


fix, where a and b are 


differentiable functions of t and where and are continuous in 

X and t, then 


dt 
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/(O) All later step functions in the approximation are of inhni- 
tesimal magnitude, and their contributions in the limit will have 
to be taken into account by integration Specifically, since 


AX 


d[ 

di 


= /'(X) 


we have for the height A/, of the general infinitesimal step function 
the approximate expression 

A/. = /'(X,) AX. 

Now if A(0 IS the indicial admittance of the system, the first 
step function/(O)a(O produces a response equal to 

/(O)A(O 

from the veiy definition of the indicuil admittance as the response 
per unit excitation For the second stcfi function A/i u{t — X]), 
there is a lag of f = Xi units of time before it begins to aet Hence 
the inhnitesimal response it produces is 

A/,A(/-X,) or /'(XO AXi A(/ - X,) 

Similarly, the third step function prodnc(\s the iespouse 
J' 0 ^ 2 ) AX2 A (/ — Xi) 

and in general the (? 4 l)Hf sf(‘P function [iroducos the response 
/'(X.) ^X, A(t - X.) 

If lliese contnbutions to the total resjionse are added, we obtain 
for the response at a genera! tune / 

!/(/) =/(())A(0 4-/'(X,) AX,/1(/ - Xi) +/'(A2) ax, A(/ - X,) + 

-f j\K) AX. A{t - X.) 4 
- fmA(t) + 2:/'(X.)A(/ X.) AX. 

the summation extending over all tlie steji functioiis which have 
begun to act up to the instant / In the limit when AXi approaches 
zero and the height of each ste}) function after lh(‘ first,/(0)i/(0. 
aiiproac'hcs zero, the sum in the last expression becomes an 
integial, and, except foi the dummy variable, we have Eq. (12) 
To giv(' a physical interpretation of F]q (10), we must first 
determine the siginheanee of tlie derivative of the indieial admit- 
taiK'e, A'(t) I’o do this, we shall need the concept of a uml 
nitpulse. 

Suppose that we have the function shown in Fig. 7 19 
This consists of a suddenly applied excitation of constant mag¬ 
nitude acting for a certain period of time and then suddenly 
ceasing, the pioducl of duration and magnitude being unity 
If a IS very small, the period of application is correspondingly 
small but the magnitude of the excitation is very great It is 
sometimes convenient to pursue this idea to the limit and imagine 
a forcing function of arbitrarily large magnitude acting for 
an infinitesimal time, the product of duration and intensity 
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rnnaliniig unity as a —> 0 The resulting “function” is usually 
referred to as the unit impulse l{t) or the 5 function b{t) f 

In somewhat different terms, the 6 function — ^o) is often 
described Viy the following purported definition- 


(13a^ 

- t„) = 

(13ft) 

C S(< - ft.) (It = 1 


Taken literally this is nonsense, for the area under a curve which 
coincides with the /-axis at every point but one must surely V>e 
zero and not unity, as asserts However if (13) is considered 

to be merely suggestive of the limiting process by which vse first 
described the unit impulse, then, whatever its shortcomings as a 
definition, it is at least as meaningful as certain other useful and 
reasonably “respectable” concepts in applied mathematics 

Consider, for instance, the familiar concept of a concen¬ 
trated load on a beam (Fig 7 20a) Clearly, such a load is jihysi- 
cally unrealizable and must be viewed as an idealization of the 
following nature Imagine that over the interval (jo, To + a) the 
beam bears a divStributed load whose magnitude per unit length 
is P/a (Fig 7 206) Then no matter how small a may be, the 
total load on the beam, being equal to the jiroduct- of the intensity 
P/a and the interval length a, is just P As a —> 0, the ideal coh- 
ce|)t of a concentrated load thus emerges as the limiting form 
of a realizable distributed load If one were now asked to describe 


t More specifically, 6(0 is often called the Dirac 5 function, after the British 
theoretical phyfiicist PAM Dirac (1902- ) 
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figure 7.20 

Plot suggesting 
the interpreta¬ 
tion of a 
roneentrated 
load on a beam 
as a unit impulse 

(b) 


0 

I 


r 


Load per unit length ^ 


A,, Aq + a 


I 

L 

i 


(14a) 

(14b) 


(15) 


( 10 ) 


the load per unit length ip(j;) in the liiniling ease, one would 
probably give the following "definition”. 


w{x) dx = P 

which corresponds in all esseniml respecis to the description of 
the 6 function provided by (11^) 

One interesting and important projierty of the 6 function is 
its ability to isolate or reproduce a particular value of a function 
f(l) ai irdiiig to the following formula 




To justify this we revert to the prelimiling a])proximation to the 
6 function and use it in jilace of 5(/ — ^i) in (lo) This gives us 
the approximating integral 



Now, by the law of the mean for integials,* this integral is equal to 



/() < f < fo 4 u 


Now as a —> 0, jierfoice ^and so, from (lb), the integral 
approaches/(/o), as assertial 

The unit impulse is only the first of an mhnite sequence of 
so-called singularity functions. As a direct geneialization of the 
unit impulse we have the unit doublet (Fig 7 21), defined 
(loosely) as 

w(/) — 2u(f — g) - h u ( t — 2a) 


• This asserts that, if fit) is continuous over the closed range of integration 
a ^ I ^ b, then there exists at least one value of t, say t — f, between a and b 
such that 

dt - (b - a)/({) 
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FIGURE 7.21 
Plot suggesting 
the nature of a 
unit doublet 


/(n 



I 


-!-[«(()+ [u((-2a)l 
a _ 


t - 


- ^ u{t- a) 
a~ 


the unit triplet, defined similarly as 

lini ~ — g), 4- — 2a) — u(l — 3a) 

a-*o 

and so on, indefinitely Some of (he properties of these “func¬ 
tions'' will be found among the exercises at the end of this section 
It IS interesting and important that in many applications 
the use of the 6 function can be rigorously justified by arguments 
based on what is known as the Stieltjvh integral * a generalization 
of the familiar Riemann integral More generally, the singularity 
functions are examples of mathematical objects known as gen¬ 
eralized functions, or distiibutions, which are studied in the 
recently developed theory of distributions f 

To determine the l^aplace transform of a unit impulse, we 
return to the prelimiting approximation 

u{t) — u{t — g) 
a 

shown in Fig 7 19 Transforming this expression, we have, for 
all g > 0, 

1 /l _ _ 1 — 

g \ A’ 8 / as 

As g —> 0, this transform assumes the indeterminate form 0/0, 
but, evaluating it in the usual way by L'Hospital's rule, we obtain 


* Named for the Dutch mathematician T J Stieltjes (1856-1894) 
t An introductory account of the theory of distributions can be found in 
Athanasios Papoulis, "The Fourier Integral and Its Applications," pp 269- 
282, McGraw-Hill Itook Company, New York, 1962, 
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immediately the limiting value 1 In the same way we can show 
that the transforms of the unit doublet and the unit triplet are, 
respectn'’ely, s and s*, and the transforms of the other singularity 
functions follow exactly the same pattern Since these transforms 
do not approach zero as s becomes infiivte, we know from Corol¬ 
lary 1 of Theorem 5, Sec. 7 1, that t hey are not the transforms 
of piecewise regular functions of exponential order This, of 
course, is obvious, for although the singularity functions a’l. all 
of exponential order, they are limiting forms involving unbou ded 
behavior in the neighborhood of the origin and hence are not 
piecewise regular 

We are now in a position to resume our attempt to give a 
physical interpretation to Formula (10) For convr nienr'e let us 
denote by h(l) the response of th(‘ system under discussion when 
the driving function is a unit impulse We have already seen (Eq 
(6)1 that 


■cli/WI = 


^\m \ 

Z{s) 


Hence, if/(^) IS a unit impulse, M) that-Ji I/(/) I = 1 and j/(/) = h(t), 
we have 

* "" I(s) “ 

Thus, from Theorem 3, Sec 7 4, it follows that 


h(t) = 


rM(0 

df 


A'(0 


or, in words, the I'esponse of n system to n unit impulse is the deriva¬ 
tive of the lesporise of the system to a unit step fumtion 

Now let /(O, in the general case, be aiijiroximated by a series 
of infinitesimal impulses, as showm in Fig 7 22 For the first 


figure 7.22 
Plot shoiving the 
synthesis of a 
general function 
by means of 
impulses 
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impulse, whose magnitude by definition is the product 
/(O) AXo = /(Xo) AXo 

the infinitesimal response is [/(Xo) AXo]yl'(0^ since A'{i) s h{t) is 
the response per unit impulse. The second impulse does not occui 
until / = Xi, hence the response it produces is [/(Xi) AXi]i4'(/ — X|), 
and in general, the response produced by the (i l)8t impulse is 

[f(K) AK]A'(t - X.) 

If these contributions to the total response are added, we obtain 
for the response at a general time t 

y(t) = XfMA'il - X.) AX. 

the summation extending over all impulses which havi acted on 
the system up to the time t In the limit when eacdi AX ), t! ■ 
last sum becomes an integral, and we have Forniula (10) 


EXERCISES 

Find the invf rse of each of the following transforme 
I 

. " (s’+9)» 


+ 2 

fi" -f- 4« + 4 


A 2s -f- 3 

5 * + 4 

_ I'J: ~ 


(«> 48 -f 13)» 

Using the .;orvolution formula, find a particular int gral of the equation 
y" -f 2ay' + a^y « fit) 

Using the convolution formula, find a particular integral of the equation 
y" + (a + b)y' -|- aby - f{t) 


9 Verify that the Laplace transform of the unu doublet is « and that the Laplace (ransfoini 
of the unit t iplet is s* 

10 It D{t) denotes the unit doublet function, show that 

- to) dt - -/'(/o) 

11 Find A(C and hit) for the equation y" -|- -f 2^/ - 0, verify that h{i) = A'{t), and then 
verify Formulas (10) and (12) when this equation is'^'driven" by the function /(U = c* 

12 a Find A(0 and h{i) for the system shown in Fig 7 23 if the iniiut is applied to mi and 

if the output IS the respionse, i e , displar*enient, of Verify that h{i) = A'{t) What is the 


FIGURE 7.23 




Ai-1 


A, = i 


m , = 2 


*j = 2 


I 


response of mj to an arbitrary force /(<) applied to mi when the system is at rest in its 
t^uUibnum position? 

b^Work part a if the input is applied to wn and the output is the response of mi 
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13 Find i4(/) and h(t) for the system shown in Fig 7.24 if the input is applied across the indi¬ 
cated terminals and if the output is the current through R 2 Verify that h{i) — A'{t) What 
IS the current through /?2 due to an arbitrary voltage E{t) applied across the terminals 
when all charges and currents m the system are zero ? 


Cl = 0 5x10' 



R, -3x10" 



14 Show that the solution of the equation oy" + 61 /' + n/ = 0 (//„ * 0, i/p — 1) is exactly 
the same as the solution of the equation ay” f hi/ ty «=> a5(t) (j/o * Vo ” h)oe 8 this 
fact have a physical interpretation? With whi.t combination of singuUnty functions must 
an initially passive, second-order equation be driven 111 order to have the same solution 
as llie undriven equation with initial conditions y = ya, y' = y't/ 

16 Show that^ ~~ dX 

16 Show that/(0*[y(0*^‘ ’ = and that 


-t ^(0) “ 1/(0*(7(0] ± [m*h(t \ 

17 Show that JE{/(0)£lg(0l£f^(f)) = £{/(0*t/(0*^(0) 

18 Show that 1*1 = < and that 1 * 1*1 »» iV2 What is the generalization of these results to 
n factors? 

19 Evaluate (a) 8(t — a)*f{i), (b) u(t — a)•/(<), (c) if m and n are nonnegative integers 

20 If/(O) - y(0) “ 0 , show that/'(()*f/(0 = f{t)*g'(t) and that 


im^gd)]' 
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CHAPTER EIGHT 


Partial 

Differential 

Equations 


8.1 

Introduction In our previous work we have seen how the analysis of mechanical 
and electrical systems containinj? lumped parameters often leads 
to ordinary differential equations However, assumptions to the 
effect that all masses exist as mass points, that all springs are 
weightless, or that the elements of an electrical circuit are concen¬ 
trated in ideal resistances, inductances, and capacitances rather 
than continuously distributed are frequently not sufficiently 
accurate In such cases a more realistic approach usually leads to 
one or more partial differential equations which must be solved 
to obtain a description of the behavior of the system In this 
chapter we shall discuss such equations as they commonly arise 
in engineering and in jiliysics Wc shall begin our study by exam¬ 
ining in detail the derivation from physical principles of certain 
typical partial differential eciuations Then, knowing the forms 
of most frequent oecurrence, we shall investigate methods of 
solution and their ajiplication to specifie problems 


8.2 

The derivation of equations 

One of the first problems to be attacked through the use of partial 
differential equations was that of the vibration of a stretched, 
flexible string Today, after nearly 250 years, it is still an excellent 
initial example 

Let us consider, then, an elastic string, stretched under a 
tension T between two points on the x-axis (Fig. 8 la) The 
weight of the string per unit length after it is stretched we sup¬ 
pose to be a known function w{x). Besides the elastic and inertia 
forces^inherent m the system, the string may also be acted upon^ 
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by a distributed load whose magnitude per unit length we assume 

to be a known function of x, y, and the transverse velocity y, say 
In formulating the problem we assume that 

a The motion takes place entirely in one plane, and in this plane 
each particle moves at right angles to the equilibrium position 
of the string 

b The deflection of the string during the motion is so small that 
the resulting change m length of the string has no effect on 
the tension T. 

c The string is perfectly flexible, i e , can transmit force only 
in the direction of its length 

d The slope of the deflection curve of the string is at all points 
and at all times so small that with satisfactory accuracy sin a 
can be replaced by tan a, where a is the inclination angle of 
the tangent to the deflection curve 


Gravitational and frictional foi(‘es, if anv, we suppose to be taken 
into account in the expression for the load per unit length 





(a) 

FIGURE 8.1 

A typical element of a vibrating string 



With th(\se assumptions in mind, let us consider a general 
infinitesimal segment of tlie string as a free body (Fig 8 1^;) 
By assumption a, the mass of such an element is Aim = w(x) Ax/g 
By asBumiition b, the forces which act at the ends of the element 
are the same, namely, T By assumption c, these forces are 
directed along the respective tangents to the d(3fleetiOi: curve; 
and, by assumption d, their transverse components are 

T sill a-i = T sin a: I =7’ tan a 

\x + Ax + ^ 

and T sin ~ T sin a = T tan a 


The acceleiation produced in Am by these forces and by the 
portion of the distiibuted load/(j;,y,y,f) Ax which acts over the 

^2w 

interval Ax is approximately where y is the ordinate of an 

arbitrary point of the element. The time derivative is here 
written as a partial derivative because obviously y depends not 
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( 1 ) 


( 2 ) 


(3) 


only upon t but upon x as well. Applying Newton’s law to the 
element, we can thus write 


= Ttanal 

g dt^ 
or, dividing by Ai, 

^ tan a 1 — tan 


- T tan a + f{x,y,y,i) Ax 


w (x) _ /T^ K 
'•(? dt^ \ 


k + Ax 


Ax 


li.) 


+ fix,y,y,i) 


The fraction on the right-hand side consists of the difference 
between tan a at x -|- Ax and at x, divided by the diffeience Ax 
In other words, it is precisely the difference quotient for the 
function tan a Hence its limit as Ax 0 is the derivative of 

, , d tan a di/ 

tan a with resiiect to x, that is, since tan a = 


dhi 

this can be written simply result, then, is that 

the deflection y(x,t) of a stretched string satishes the partial 
differential equation* 


d'^y 

di^ 


l9_ 4. 

w{x) dxJ 


w{x) 




In most important applications the weight of the string per unit 
length w(x) is a constant, and there are no external forces, i e , 
f(x,y,y,t) is identically zero When this is the case, Eq (2) reduces 

to the one-dimensional wave equation 

^ a a -^ = ^ 

dt^ dx^ W 


The dimensions of are 

Force X acceleration _ {ML/T'^){L/T'^) _ 

Weight/unit length {KiL/T^^)\\,'L) T‘^ 

that 18 , a has the dimensions of velocity The significance of this 
will become apparent in Sec 8.3 when we discuss the D’Alembert 
solution of the wave equation 

Closely related to the vibrating string is the vibrating mem¬ 
brane To obtain the partial differential equation desenbing its 
behavior, we suppose that it is stretcln^d across some closed 
curve C in the x,^-plane and that when it vibrates each particle 
moves in a direction jicrpendicular to the x,//-plane We assume, 
further, that the weight per unit area of the membrane after it is 


• The Question of what constitutes a satisfactory derivation of the partial 
differential equation desonbirij^ a given physical system is not a simple one 
To attempt to give a careful limiting argument is, in effect, “to strum at a 
gnat and swallow a camel,” since, being ultimately atomic, no physical 
system is continuous Perhaps our purported derivations should be regarded 
merely as plausibility arguments suggesting that certain partial differential 
equations be accepted as the axioms of a theoretical or “rational” study of 
applied mathematics, whose practical importance, m contrast to its purely 
mathematical interest, is to be judged by how well its conclusions describe 
past observations and predict new ones 
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( 4 ) 




stretchod is u known function y'(jr,y) and that the tension per 
unit length is the same at all ])onits and in all directions Finally, 
we suppose that the mcmbraiK' is acted upon by a known dis¬ 
tributed force whose magnitud<‘ per unit area is f(x,y,z,z,f) Then 
by computing the transverse, or ^-components, of the tensile forees 
acting across the boundaries of a typical two-dimensional element 
of the membrane (Vig 8 2) and applying Newton’s law to the 
mass of such an element, w(‘ find without difhculty that the 
deflection of the membrane z{ 2 ,y,t) satishes the eiiuation 


di^ 


__ -V- 

w{i',y) \dx‘^ dy^/ 




f{x,y,z,z,t) 


If the membrane is uniform and if there are no external 
forces, 1 e , if f(x,yyZ,z,t) = 0, then Eq (4) reduces to the two- 
dimensional wave equation 



Here, as in the case of the vibrating string, the parameter a has 
the dimensions of velocity 

As a third problem leading to a partial differential e(|uation, 
let us consider a shaft vibrating torsionally (Fig 8.3a) The 
material of the shaft we lissume to have a modulus of elasticity 
in shear K, and to l)e of uniform weight per unit volume p The 
cross-section area of the shaft at a distance x from one end we 
siqipose to be a known function, say A{x) The polar moment 
of inertia J (j) of a general cross se(;tion about its center of gravity 


FIGURE 8.3 

A l.>pK'al element 
of a vibrating 
shaft 
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we also suppose known. In addition to the obvious elastic and 
inertia torques, the shaft may also be acted upon by a distributed 
torque whose magnitude per unit length is a known function, 
say where 6 is the angle through which a general cross 

section has rotated from its equilibrium position and ^ is t(ie 
angular velocity with which that cross section rotate.^ while the 
shaft is vibrating We assume further that 

a All cross sections of the shaft remain plane during rotation 
b Each cross section rotates about its center of gravity 
c The shape of a general cross section does not depart greatly 
from a circle. 


Frictional torques, if any, we suppose to be taken into account 
in the expression for the distributed torque per unit length, 

fixMt)- 

We begin by considering as a free body an infinitesimal 
ment of the shaft bounded by two cross sections a distance Ax 
apart (Fig. 8.36). The mass of such a disk is approximately 

Q 

and its radius of gyration is 



Hence, its polar moment of inertia is approximately 
J{x) pA(x) Ax J{x)pAx 


A1 = Am = 


A{x) 


The rotation of such an element is produced by the portion 
of the distributed torque /(x,0,^,0 Ax which acts on it and by 
the torque T, transmitted to it through the end sections by the 
adjacent portions of the shaft Theieforc, applying Newton’s 
law in torsional form, we have 
./(x)p Ax d^d 


dt‘^ 


= T 


1*4" Ax 


— T fix, 6,^, t) Ax 


or, dividing by Ax and then letting Ax 


J (x)p d^d 
g ^ 


dx 


fix,e,$,t) 


0, 


Now, from strength of materials, we recall that the torque 
transmitted through any cross section of a twisted shaf s pro¬ 
portional to the twist per unit length, i.e , the slope of ti ^ iB,x)' 
curve at that cross section. 



The proportionality constant k is known as the torsional rigidity. 
For shafts which are solids of revolution it can be shown that 

k ^ EJix) 
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( 8 ) 


and this result can be used with satisfactory accuracy whenever 
the cross sections of a shaft are approximately circular. Hence^ 
in such cases Eq. (6) becomes 


J{x)p dW 
g 



-hf(x,eM 


However, for configurations whose cross sections differ appreci¬ 
ably from circles, it is necessary to determine the torsional rigidity 
k by experimental means and continue the solution of Eq. (6) 
by numerical rather than analytical methods. 

In most elementary applications the shafts are of uniform 
circular cross section and there are no external, distributed tor¬ 
ques. In such cases J(x) is a constant,is identically zero, 
and Eq. (7) therefore reduces to 


dP ® 


a* 




p 


which is again just the one-dimensional wave equation. 

Another vibration problem of considerable practical interest 
concerns the transverse vibrations of a beam. To obtain the partial 
differential equation describing these vibrations, let us first choose 
a coordinate system such that the beam in its undeflected position 
coincides with a portion of the r-axis and the deflections occur in 
the direction of the y-axis A general cross section of the beam we 
assume to be of known area A(x) and known moment of inertia 
I{x) about its neutral axis. The material of the beam we suppose to 
be of weight per unit volume p and modulus of elasticity E. In 
addition to the intrinsic elastic and inertia forces, the beam may 
also be acted upon by a distributed load of known intensity 
f(Xfy,y,t). Gravitational and frictional forces, if any, we suppose 
included in this distributed load. Finally, we assume that all 
particles of the beam move in a purely transverse direction, i.e., 
that the slight rotation of the cross sections as the beam vibrates 
IS negligible 

Now from the discussion in Sec. 2.6 we recall the following 
formulas of beam flexure: 


M(x) = Elix) g 


dM(x) 

dx 


= V{x) 


dVjx) 

dx 


-w(,x) 


where M(x) = bending moment at a general cross section 

V{x) = shear, or net transverse force, to the right of a gen¬ 
eral cross section 

w(x) = load per unit length at a general cross section 
Hence, combining these relations into a single equation, we have 



(9) 
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( 10 ) 


( 11 ) 


where the derivatives are now written as partial derivatives, since 
m our problem y depends upon t as well as upon x 

During vibration the load per unit length on the beam consists 
of two parts: the external load f{x,y,y,i) and the inertia load due 
to the motion of the beam itself. Now the mass of an infinitesimal 
segment of the beam of length Ax is approximately lpA{x) Ax]/g, 


d'^y 

and the transverse acceleration of such a mass clement is —. 


Hence the inertia load per unit length is 


Ax 


pA(x) 

g~ 


and, therefore, the total load per unit length is 
w{x) = +/(-r.y.j/.f) 


Substituting this into Eq (9), we have finally 

EI(x) 


f 


= -~A{x)^)-f{x.y,y,l) 


In many important applications the beam under considera¬ 
tion IS of constant cross section and there is no external load, that 
is, A and I are constants and /(x,t/,i/,/) s 0. Under these (*ondi- 
tions hlq (10) reduces to the simpler form 


dx* dt^ 




Ap 


In this case the parameter a does not have the dimensions of 
velocity 

An entirely different class of problems leading to partial differ¬ 
ential equations is encounU'red in the study of the flow of heat in 
conducting regions To obtain the equation governing this phe¬ 
nomenon we must make use of the following experimental facts. 


a Heat flows in the direction of decreasing temperature 
b The rale at which heat flows through an area is proportional to 
the area and to the temperature gradient normal to the area 
c The quantity of heat gained or lost by a body when its tem¬ 
perature changes is proportional to the mass of the body and to 
the temperature change. 


t The sign of the inertia load per unit length can be checked by observing 
that, when the beam is instantaneovifily concave toward the positive y-axis, 
its elements are either losing velocity in the negative y-direction or gaming 
velocity in the positive y-direction and, hence, have positive acceleration 
Therefore the inertia load per unit lenrth is positive, as required bv the 
convention we established in Sec. 2 6 (Fip 2 2) Similarly, when the beam 
IS instantaneously* convex toward the pi^itive the acceleration of its 

particles is negative, and so, too, is the inertia load per unit length. 
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( 12 ) 


(13) 


The proportionality constant in b is called the thermal con¬ 
ductivity of the material k. The proportionality constant in c is 
called the specific heat c. 

Let us now consider the thermal conditions in an infinitesimal 
element of a conducting solid (Fig 8.4). If the weight of the con¬ 
ducting material per unit volume is p, the mass of such an element 


^ p Ax Ay Az 
9 

Then, if Au is the temperature change which occurs in the interval 
At, the quantity of heat stored in the element in this time is, by c, 
cp Ax Ay Az Au 


AH = c Am Au = 


9 


and the rate at which heat is being stored is approximately 


AH cp ... Au 

— Ax Ay Az ~- 
At g At 


The heat which produces the temperature change Au comes 
from two sources In the first place, heat may be generated through¬ 
out the body, by electrical or chemical means for instance, at a 
known rate per unit volume, my f{x,y,z,l). The rate at which heat 
IS being received by the element from this source is, then. 


f(x,y,z,t) Ax Ay Az 


In the second place, the element may also gain heat by virtue of 
heat transfer through its various faces 

In particular, the rate at which heat flows into the element 
through the rear face EFGH is, by h, approximately 


— k Ay Az 


du 

dx 


\v+H 


Ay 

Ac 


where, as an average figure, we have used the temperature 
gradient du/dx at the mid-pomt of the face (x, y + }^2 Ai/, 
2 -h yi Az). The minus sign is necessary because the element gams 
heat through the rear face if the normal temperature gradient, 


FIGURE B.4 

A typical volume 
element m a 
region of three- 
dimensional heat 
flow. 





PARTIAL DIFPIRENTIAL EQUATIONS 


CHAP. • 


(14) 


i.e., the rate of change of temperature in the x-direction, is nega¬ 
tive. Similarly the element gams heat through the front face at the 
approximate rate 

The sum of these two expressions is the net rate at which the ele¬ 
ment 18 gaining heat because of heat flow in the x-direction. 

In the same way we find that the rates at which the element 
gams heat because of flow m the y- and 2 -directions are, 
respectively, 


— kAxAz- 


k Ax Az^ 




-k Ax Ay 


dz ^ 

V + HAy 


+ k Ax Ay 


dz » + H Ai 

e +Ar 


Now the rate at which heat is being stored m the element (12) 
must equal the rate at which heat is being produced m the element 
(13) plus the rate at which heat is flowing into the element from 
the rest of the region Hence we have the approximate relation 

^ Ax Ay Az^ = f{x,yyZ,t) Ax Ay Az 


k Ay Az 


k Ax Az 


Aj. x + Ax 
v+u Ay 
r + H Az 


x + H Ax 
y + Ay 
i + Az 


k Ax Ay I — 


du 

Yz 

V + H Ay 
z + Az 


x + H Ax I 
y + Vl Ay j 


P'mally, dividing by k Ax Ay Az and letting Ax, Ay, Az, and At 
approach zero, we obtain the equation of lieat conduction 

du d^u d^u d’^u , 1 .X , cp 


The parameter a m this equation does not have the dimensions of 
velocity. 

In many important cases, heat is neither generated nor lost 
m the body, and we are interested only m the limiting, steady- 
state temperature distribution when all change of temperature 
with time has ceased. Under these conditions hoih. }{x,y,z,t) and 
du/di are identically zero, and Eq (14) becomes simply 

dhi d^u d^u _ 


(15) 
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This exceedingly important equation, which arises in many 
applications besides steady-state heat flow, is known as Laplace’s 
equation and is often written in the abbreviated form 

V*u = 0 

As a final example of the derivation of partial differential 
equations from physical principles, we consider the flow of 
electricity in a long cable or transmission line. We assume the 
cable to be imperfectly insulated so that there is both capacitance 
and current leakage to ground (Fig. 8 5). Specifically, let 
X — distance from sending end of cable 
eix,t) = potential at any point on cable at any time 
t{x,t) = current at any point on cable at any time 
R = resistance of cable per unit length 
L = inductance of cable per unit length 
G = conductance to ground per unit length of cable 
C = capacitance to ground per unit length of cable 

Now the potential at Q is equal to the potential at P minus 
the drop in potential along the element PQ Hence, referring to the 
equivalent circuit shown in Fig. 8 56, 

e{x -h Aj) = e(i) — {R /\x)i — (L Ax) 

di 

or e(x -h Ax) — e(x) ^ Ae = —(R Ax)i — (L Ax) -- 
or finally, dividing by Ax and then letting Ax approach zero, 

1 = 

Likewise, the current at Q is equal to the current at P minus 
the current lost through leakage to ground and the apparent cur¬ 
rent loss due to the varying charge stored on the element Hence, 
referring again to Fig 8 5, 

?(x + Ax) = 7(x) — (G Ax)€ — (C Ax) — 


i{x -1- Ax) — z(x) s A? 


-{GAx)e - (P Ax) 


or finally, dividing by Ax and then letting Ax approach zero, 


.9 



c(x4- Ax) 
i(x-(-Ax) 


FIGURE B.5 


A typical element of a transmiBsion line. 
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(19) 


( 20 ) 


(21a) 

( 216 ) 


If we differentiate Eq (17) with respect to x and Eq. (18) 
with respect to t, we obtain 

at dx ~ di “ 

dH f dH \ 

If we eliminate the term —--- ( = t—^ J between these two 

dt dx \ dx dt/ 

equations and then substitute for ^ from (18), we hud that e 
satisfies the equation 

g, = U«g + (KC + (?L)| + «(7. 

By differentiating p]q (17) with respect to t and Eq (18) 
with respect to x and then eliminating the derivatives of c, we 
obtain a similar equation for t. 


Equations (19) and (20) arc known as the telephone equations. 
Two special cases of the telephone equations are worthy of 

note 

a If leakage and inductance are negligible, that is, if G = L = 0, 
as they are, for example, for coaxial cables, Eqs (19) and (20) 
reduce, respectively, to 


dx^ dt 


dH 

dx^ 


RC 


di 

Jt 


These are known as the telegraph equations. Mathematically, 
they are identical with the one-dimensional heat equation, 
that IS, the equation to which (14) reduces when ther are no 
heat sources in the conducting region and the tenn rature 
depends only on one space coordinate, 
b At high frequencies the factor introduced by the time ( fferen- 

tiation is large. Hence the terms involving e and or i and ^ 

are insignificant in comparison with the terms containing the 

d^e dH 

corresponding second derivatives and —• In this aise 
Eqs. (19) and (20) reduce, respectively, to 




SEC. 8,2 


THE DERIVATION OF EQUATIONS 


293 


Each of these is an example of the one-dimensional wave equation 
[Eq. (3)], \ ^LC bavin", in fart, the dimensions of velocity 
These equations an* obtained at any frequency, of course, if 
72 = (7 = 0 . 

It IS interesting to note that nowhere m the derivation of any 
of the preceding eijuations was any use made of boundary condi¬ 
tions In othei words, the same partial difTerential equation is 
satisfied by a vibrating beam, for instance, whether the beam is 
built-in at one end and free at the other, built-iri at both ends, or 
simjily supjiorted at both ends Similarly, the flow of heat in a 
body IS desrTibed by the same equation whether the surface is 
maintained at a constant temperature, insulated against heat loss, 
or allowed to cool freely by conduction to the surrounding 
medium In general, as we shall soon see, the role of boundary 
conditions, for example, permanent conditions of constraint or of 
temperatiin^, is to determine the/c/ m of those solutions of a fiartial 
difTerential equation which aie relevant to a particular problem 
Subsequent to this, the initial conditions of displacement, velocity, 
or temperature, say, determine specific values for the arbitrary 
constants appiniring in these solutions 


EXERCISES 

1 Supply ttic details of the derivation of Eq (4) for the transvcrBc vibrations of a membrane 

2 What IS the form of the heat equation if the theinial conductivity k and the specific heat c 
vary from point to point in the body*-* 

3 Consider the telephone equations m the so-called distortionless case when R(' » l/r, and 

put a* “ RO and i;* ==> 1 /U' Prove that if c(r,0 [or, equally well, is written m the 

form e{x,t} « then the function y satisfies the wave equation 


^ dx^ ” 

(Note: To avoid confusion with the voltage, < is here used in place of e to denote the base 
of natural logarithms ) 

4 Derive the partial differential equation satisfied by the ijoncentration u of a liquid diffusing 
through a porous solid (Hint. The rate at which liquid diffuses through an area is propor¬ 
tional to the area and to the concentration gradient normal to the area ) 

8 Consider a region of space filled with a moving fluid I^et the density of the fluid at the 
point {x,y,z) at time t bo p(x,y,z,t), and let the particle instantaneously at the point (x,i/, 2 ) 
have velocity components Vr, v^, and Vg, respectively, in the directions of the coordinate 
axes By considering the flow through an infinitesimal region of dimensions Ax, Ay, Az, show 
that the velocity components satisfy the so-called equatloii of continuity: 


d{pv») djpvy) djpvg) ^ 

dx dy Oz 


0 


If u(x,t) 18 the displacement of a general cross section of a bar which is vibrating longi- 
tudmally, show that 


a*w 


Eg 


p 



dx 
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where A (x) is the crosB-sectional area of the shaft, E is the modulus of elasticity of the 
material of the shaft, and p is the weight per unit volume of the material. (Hint. Use the 
definition of the modulus of elasticity, 

^ stress force/unit area 
stram stretch/unit length 

to obtain the expression 


F 


EA 


fht 

dx 


for the force transmitted through a general cross section of a stretched bar ) 
7 a Show that Laplace's equation in three dimensions 
dhb d^u d^u ^ 

dx^ dy^ olz* 

18 satisfied by the function 

_ 1 __ 

y/{x — o)* + (i/ - b)^ -h (z — r)* 
for all values of the constants a, h, c 

b Determine whether Laplace’s equation in two dimensions 


d^u d^u 
di* By* 

is satisfied by the function 

J_ 

\/{X - u)* -f (i/ ~ 6 )® 

6 Show that Laplace’s equation in two dimensions is satisfied by the function 
V “ In [fi - a)2 + (y — />)*! 
for all values of the constants a and b 
9 Show that, if Zi(x,y) and Zi(x,y) are solutions of the equation 

d^z B^z 8*2 87 8z 

— + P2(j’,y) 7“— + -- + q 2 (x,y) -- + r,(j ,?/)2 = 0 

8x* Bx By By^ Bx By 

then for all values of the constants Ci and Cz the expression CiZi(j,i/) C2Zt{x,y) is also a 
solution 

10 Show that, when Laplace’s equation in cartesian coordinates 

8®u 8*it 8*1/ 

8x* 8y* 8z* 

is transformed into cylindrical coordinates by means of the substitutions x == r cos 8, 
1/ ” r sin 8, 2 “ z. It becomes 

8*w 1 8u 1 8*u BHl 

— 4"-4-4~ — “ 0 

8r* r Br r* 88* 82* 


8.3 

Th« D'Al^b«rf solution of the wove oquation 

Each of the partial differential equations we encountered in the 
last section can be solved by a method of considerable generality 
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( 1 ) 


( 2 ) 


known as separation of variables. For the one-dirnensional wave 
equation, however, there is also an elegant, special method 
known as D’Alembert’s solution* which, because of the impor¬ 
tance of this equation, we shall examine in some detail before 
developing more general techniques 

The whole matter is very simple In fact, if / is a function 
possessing a second derivative, then 


df(x — at) 
d^f (x — at) 


= —af{x — at) 
= a^f'\x — at) 


dx 

(Vfix - at) 


at) 


dx'^ 


= n-r - at) 


and from these results it is evident that y = /(x — at) satisfies the 
equation 


_ d^_y 
a/2 ^ ax2 


It IS an equally simple matter to prove that^ if g is an arbitrary 
twice-diffcreiitiable function, then y = g{x + at) is likewise a 
solution of (1) Hence, since (1) is a linear equation, it follows 
that the sum 

y = f{x - at) H- g{x + at) 

is als( ■ solution In fact, it can he shown (see Exercise 10) that 
if / and g are arbitrary twice-diffeieiitiable functions, then (2) is a 
complete solution of (1) 

This form of the vSolution of the wave eciuation is especially 
useful foi revealing the sigmhcaiicc of the parameter o and its 
dimensions of velocity Suppose, specifically, that we consider the 
vibrations of a uniform stringf stretching from — oo to cc Jf its 
transverse displacement is given by (2), we have in fact two waves 
traveling in ojiposite directions along the string, each with velocity 
a. For consider the function f(x — at) At / — 0, it dehnes the 
curve y = /(x), and at any later time t = /i, it defines the curve 
y = /(x — ati) But these two curves are identical except that the 
latter is translated to the right a distance equal to a/i. Thus the 
entire configuration moves along the string without distortion a 
distance of at\ in /i units ot time The velocity with which the 
wave is propagated is therefore 



* Named for the French mathematician Jean le Rond D’Alembert (1717- 
1783) The D’Alembert solution is actually not a special method but rather a 
special application of a general procedure known as the method of characteris¬ 
tics Unfortunately, this cannot be applied with comparable simplicity to 
problems involving the heat equation and Laplace’s equation, and so, despite 
its theoretical interest, we shall not discuss it here An introduction to the 
theory can be found in Arnold Sommerfeld, “Partial Differential Equations 
in Physics,’’ pp. 36-43, Academic Press Inc , New York, 1949 
t The use of the string as an illustration is purely a matter of convenience, 
and any quantity satisfying the wave equation possesses the properties 
developed for the strmg 
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Similarly, the function ff(x + at) defines a confip^uration which 
moves to the left along the string with constant velocity a. The 
total displacement of the string is, of course, the algebraic sum of 
these two traveling waves 

To carry the solution through in detail, let us suppose that 
the initial displacement of the string at any point x is given by 
<l>(x) and that the initial velocity of the string at any point x is 
B(x) Then, as conditions to determine the form of / and g, we 
have, from (2) and its first derivative with respect to tj 

( 3 ) y(x,0) = (/>(x) = f(x) + g(x) 

(4) || 1^^^ = ff(x) - - af’(x) + ag'(x) 

Dividing Eq (4) by a and then integrating, we find 

-/(^) + gix) ^ \ r Hr) dx 
a Jxo 

Combining this with Eq (3) and ml reducing tlie dummy variable 
s in the integrals, we obtain 

fix) 9(,,)d,sj 

gix) = ~ [4.(x) + I £ Bis) dsj 

With th(^ forms of / and g known, we can now write 

y = fix - at) + gix + at) = - A ^(s) 

or, combining the integrals, 

(5) yix,t) = ^ P;; Bis) ds 

EXAMPLE 1 

A string stretching to infinity m both directions is given the initial displacement 


and released from re^t ]3etermine its subsequent motion 


t The initial deflection curve y = 0(i) clearly violates assumption d, Sec 
8 I, since at (for instance), ^ tan <» = = 1 78 while 

sm a = 0 87 This difficulty can easily be overcome, however, by assuming 
instead of 0 ( 1 ) a new deflection curve 




0(j) 

k 


where A: is a sulficicntly large constant, say k = 10,OCX) Using 0(x) instead of 
0 *(t) in this tfnd in similar problems is just a convenient way of eliminating 
the constant factor 1/A: at each step of our work 
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FIGURE 8.6 

Plot showing 
thp propagation 
of a disturbance 
along a two-way 
infinite string 



of - 1 0 


i 



The motion of a semi-iiifmitc string whose end is fixed is 
completely equivalent to the motion of one-half of a two-way 
infinite string having a fixed point, or node, located at some 
finite point, say the origin To capitalize on this fact we need only 
imagine the actual string, stretching from 0 to ®, to be extended 
in the opposite direction to — « . The initial conditions of velocity 
and displacement for the new portion of the string we define to be 
equal in magnitude but opposite in sign to those given for the 
actual string * The solution for the resulting two-way infinite 
string can be written down at once, using Eq (5). In the nature of 
the extended initial conditions, the displacement at the origin due 
to the wave traveling to the right from the left half of the string 

• Thifl method of extending the initial conditions is sufficient but not neces¬ 
sary (see Exercise 6). 
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will always be equal but opposite m sign to the displacement 
at the origin due to the wave traveling to the left from the right 
half of the string Hence the string will always remain at rest at 
the origin, and the solution for the right half of the extended string 
will be precisely the solution of the original problem. 

EXAMPLE 2 

A semi-mfinite etrinK la givon the displacement shown in Fig 8 7a and released from rest 
Determine its subsequent motion 

FIGURE 67 

A semi-mfinite 
strmg and its 
conceptual ex¬ 
tension. 

' (a) (b) 

We first imagine the string extended to •— w and released from rest in the extended initial 
configuration shown in Fig 8 7h Since 0(x) ^ 0, we have, from (5), 

<f>(x — at) -f <^(x 4- at) 
y{x,l) -- 

where is the displacement function shown in Fig 8 76 * We thus have two displacement 
wave^, I'ach of shape defined by ^ <‘ne traveling to the right and one traveling to the left 

along the string Plots of these waves arc shown in Fig 8 8 An inspection of these configurations 
reveals the important fad that a displacement wave is reflected from a fixed or "closed" end 
without distortion but with reversal of sign 

The motion of a finite string can be obtained as the motion of 
a segment of an infinite string with suitably defined initial dis¬ 
placement and velocity If the string is given between 0 and I, say, 
we first imagine that it is extended from 0 to — / with initial condi¬ 
tions which are equal but opposite in sign to those for the actual 
string Then we extend the string to inlinity in each direction 
subject to initial conditions which duplicate with period 21 the 
initial configuration betwt^en —I and / 

EXAMPLE 3 

A string of length I is given the displacement shown in Fig 8 9 and released from rest Determine 
its subsequent motion 

* If, as suggested by Fig 8 7a, the graph of 0(i) has one or more corner 
points, then, strictly speaking, <^(x) does not describe an admissible initial 
displacement function In fact, in the derivation of Eq. (5) both f{x) and 
aix) were assumed to be twice differentiable, and, therefore, 0 ( 1 ) must also 
be twice differentiable, which is not the case if there are points where the 
derivative of 0(j) is undefined. The apparent solutions obtained from Eq (5) 
by overlooking this fact are, therefore, at best only formal solutions, and 
are to be viewed with suspicion unless and until it is verified directly that 
they satisfy the ^iven partial differential equation and its accompanying 
boundary and initial conditions Questions concerning the existence and 
uniqueness of solutions of partial differential equations are quite difficult, 
and in our work we shall be concerned mainly with techniques for obtaining 
formal solutions. For an extended discussion of the problem of establishing 
the validity of solutions derived by purely formal means see, for instance, 
R V Churchill, ^‘Fourier Series and Boundary Value Problems," 2d ed., pp. 
126-163, McQraw-HiU Book Company, New York, 1963. 
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FIGURE 8.8 
Plot showing 
the propagation 
of a disturbance 
along a semi- 
inhnite string. 




The necessary extension of the string and one half cycle of its motion are shown in Fig 8 10 
An inspection of Fig 8 10 ows that the period of the motion, i e , the least time for its return 
to its initial state, is just the time for either of the traveling waves to traverse a distance 21 In 
other words, since the velocity of the waves is a, the period is 21/a The frequency of the vibra¬ 
tions 18 therefore a/21 We shall encounter this formula again when we solve the wave equation 
by the method of separation of variables 

FIGURE 8.9 
A finite string 
with initial 
displacement. 



1 


2 


EXERCISES 


A uniform string strctcliing from — » to oo is given the initial displacement 


y(x,0) 


1 - |x| 

0 


< 1 
X* ^ 1 


and released from rest. Find the displacement of the string as a function of x and t, and plot 
the displacement curves for at = }i, h, 1 What is the transverse velocity of the string 

at X “ 0? 

Criticize the following argument “proving” that a string displaced os m Exercise 1 and 
released from rest wull remain motionless. “At f “ 0 the displacement curve of the string 
consists exclusively of segments of straight lines, and at all points of any line, or segment 

of a line, y “ ox + 6, it is obvious that d^y/dx^ 0 Hence, at f “ 0 we have ® 0, and, 


therefore, from the wave equation 


^ ax* 

d^y 

it follows that, when i — 0, the acceleration — is zero at all pomta of the string. But if a 
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particle has zero velocity and if there is no acceleration, i e , if there is no change in velocity, 
the velocity remains zero Therefore the string will never move ”(') 

8 A uniform string stretching from — » to <* is given the initial displacement 


V(a:,0) 



x.<- 


I* g 


2 


4 


6 


6 


and released from re.st Find the displacement of the string as a function of j and t, and 


plot the displacement curves for at 


ir IT Sir 

4 2 T 


A uniform string stretching from — oo to oo, while at rest in its equilibrium position, is 
struck in such a way that the portion of the string between x = — 1 and j = 1 is given a 
velocity of 1 Find the displai’iement as a function of x and I, and plot the displacement 
curves for ai =• 1 and 2 

A uniform string stretching from 0 to « is initially displaced into the curve y = xe~^ and 
released from rest Find its displacement as a function of x and t 

A uniform string stretching from 0 to « begins its motion with initial displacement 4>ix) 
and initial velocity d{x) Show that its motion can be found as the motion of the right half 
of a two-way infinite string, provided merely that the initial displacement 0( —j) and the 
initial velocity d{ -x) for the negative extension of the string satisfy the condition 


-b 



da 


7 If a semi-infinite string begins its motion with initial displacement <l>(x) =» (sin x)/a and 
initial velocity 6(x) « 1 and if the negative extension of the string is imagined to have the 
initial displacement 0 ( —j) * 0 , find the necessary initial velocity for the extended portion 
of the string 


-I 0 _ / 



FIGURE 

Plot showing one half cycle of the motion of a finite string 
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8 The initial displacement of a two-way infinite string is 
1 


y(x,o) 


1 + X* 


I* < 00 


With what velocity must the string start to move in order that its subsequent motion will 
consist solely of a wave traveling to the right? 

9 The initial velocity of a two-way infinite string is 


. I sin X x’ < IT* 

-jo g 


From w'hat initial displacement must the string start to move in order that its subsequent 
motion will consist solely of a wave traveling to the right? 

10 Show that, under the substitutions u = x — at and r = x + at, the equation ■ ’ 




ax* 


a*?/ 


becomes —^ =* 0 Hence, show that i/ *= /(x — aO q{x -f- at, is the most general solu- 
du dv 

tion of the one-dimensional wave equation 

11 Discuss the possibility of finding solutions of the form z «« /(\j y) for the equation 


dh a*2 a*z 

A ~ -^2B --I- r — - 0 

ax* dx dy ai/’ 


A, R, C constants 


and show that, according as B* — AC is greater than, equal to, or less than zero, there will 
be two, one, or no (real) values of X for which such solutions exist (The given equation is 
said to be byperboli parabolic, or elliptic in the respective cases, and the nature of its 
solutions and their properties is significantly diffirent in each case ) 

12 The equation 


a*z a*z a*z 

A(x,y) -- + 2B(x,y) —- -f- C(x,y) ~ 
ax* Ox dy oy^ 


■/ 


( dz dz \ 

Jx dy j 


is said to be hyperbolic, parabolic, or elliptic at a point {i,y) according as B'(x,y) , 
A(x,y)Cix,y) is, respectively, greater than, equal to, or less than zero For what values 
of X and y is the equation 


a*r a*z d^z 

(1 - y) —, + 2(1 - X) —- -h (1 + y) ~ » 0 
ax* dx dy dy' 

hyperbolic? parabolic? elliptic? 

13 Let 

a *2 a*z a*z ( dz dz \ 

^ ^x,y) -h 2Bix,y) -F C(x,y) ~ * / I —’ “ ' ) 

^ ax* dx dy dy^ \ dx dy ) 

and let 0>{x,y) - ci and ^(x,v) = be the functions whose derivatives satisfy the equation 

A{x,y){w'y — 2B{x,y)w' F C{x,y) “ 0 

These functions are called the characteiiitici of the given partial differential equation, 
and, if BHx,y) - A{x,y)C{x,y) ^ 0, they define families of (real) curves which are called 

characteristic curves. 

a What are the characteristic curves of the one-dimensional wave equation? 
b If the given partial differential equation is hyperbolic, show that the change of inde¬ 
pendent variables defined by the substitutions u * tf>{x,y), v =■ 4^{x,y) will reduce it to the 


. j dz \ 

standard form - — F I z, —» —» u,v I 

du dv \ du Bv f 
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c If the Riven partial differential equation is parabolic, show that the change of inde¬ 
pendent variables dchned by the substitutions w a:, i; »» 4>(x,y) will reduce it to the 


standard form 


d^Z ( dz dz \ 

[1 - = F I Z, -» “• W,l' I 

dv^ dU 3V ) 

d If the given partial differential equation is elliptic, show that the change of independent 
variables defined by the substitutions it + “ 4»{x,y), u — tv “ ^(x,y) will reduce it to 

ah dh / dz dz A 

the standard form — + - — I z, —> —» 7t,6 I 

aw® ay* \ Su dv / 


14 Using the substitutions described in the preceding exercise, solve each of the following 
equations 


a Zrr -h 3z*„ -h 2zy 
c Zzx "H 5zj(| 
6 V^uu ™ 


b + 4z 

XU -h 4 z^„ » 0 

d XZzy + yZyy = 0 
f z„ 2(J + y)z *1/ 4- ^xyzy 


16 a Discuss the possibility of extending the D’Alembert solution to the two-dimensional 
wave equation a*(z„ + z^„) = Z|, 

b Discuss the possibility of finding solutions of the form + for the equation 

Aztz “H lizjy -h Czyy + Dz* + Ezy + “ 0 A, B, C, D, E, F constants 


Separation of variables 

Wo are now ready to conaidcr the solution of partial differential 
equations by the method of separation of variables Although 
this mothod is not universally applicable, it sufhces for most of 
the partial differential equations encountered in elementary appli¬ 
cations in engineering and in physics and leads directly to the 
heart of the branch of mathematics which deals with boundary 
value pioblcmfi 

The idea behind the method is the familiar mathematical 
stratagem of reducing a new problem to dependence upon an 
old one In this case we attempt to convert the given partial 
differential eijuation into seveial ordinary differential equations, 
hopeful that what we know about the latter will prove adequate 
for a successful continuation 

To illustrate the details of the procedure, let us again con- 
sidei the wave equation, this time taking the torsionally vibrating 
sliaft of linite length as a spccihc representation 


We assume, as a working hypothesis, that solutions for the angle 
of twist 8 exist as products of a function of x alone and a function 
of / alone 


e(x,i) = X(x)5’(0 




5£C. B.A 


SEPARATION OF VARIARLES 


903 


If this is the case, then partial differentiation of 0 amounts to 
total differentiation of one or the other of the factors of 0, and 

we have = X'T and ^ = XT". 

Substituting these into the wave equation, we obtain 

XT' = a‘^X"T 


( 1 ) 


Dividing by XT then gives 



as a nroessary eondition that d{x,t) = X{x)T{t) should be a 
solution 

Now the loft member of (1) is clearly independent of x 
Hence (in spite of its appearance) the right-hand side of (1) must 
also bo independent of j. since it is identically equal to the expres¬ 
sion on the left Similarly, each member of (\) must be independ¬ 
ent of t Therefore, being independent of both x and each side 
of (1) must be a constant, sav and we can write 



= M 


Thus he determination of solutions of the original partial differ¬ 
ential equation has been reduced to the determination of solutions 
of the two ordinary differential equations 


T" = m 7' and X" = A’ 

Assuming that we need consider only real values of m, there 
are three cases to investigate 

/ i >0 ^ = 0 ^<0 

If M > 0, write M = ^“ this case the two differen¬ 

tial equations and their solutions are 

T" = \'‘T X" = X 

T = A = 

But a solution of tlie form 

e{x,t) = X(x)T(() = -h Der^^>^){Ae^^ -f- 

cannot describe the undamped vibrations of a system because it 
IS not periodic, i e . does not repeat itself periodically as time 
increases Hence, although product solutions of the differential 
equation exist for m > 0, they have no significance in relation 
to the problem we aie considering 

If M = 0, the equations and their solutions are 

T" = 0 X" = 0 

T = At + B X ^ Cx A- D 
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But, again, a solution of the form 


e(x,t) = X(x)T(t) = {Cx + D){At + B) 


( 2 ) 


cannot describe a periodic motion Hence, the alternative m = 0 
must be rejected 

Finally, if m < 0 we can write m Then the compo¬ 

nent differential equations and their solutions are 


T" = 


T = A cos \t A- B sin \t 
In this case the solution 


X" = 
X = 


C cos - x -f- Z) sin - X 
a a 


6{x,i) = X{x)T{t) 




C cos - X D sin 
a 




(A cos \t B sin \t) 


IS clearly periodic, repeating itself identically every time t in¬ 
creases by 2ir/X In other words, 6{xfi represents a vibratory 
motion with period 2ir/\ or frequency X/2ir 

It remains now to find the value or values of X and the con¬ 
stants A, B^Cy and D Since the admissible values of X are deter¬ 
mined by the boundary conditions of the problem, the continua¬ 
tion now vanes in some respects, depending upon how the shaft 
IS constrained at its ends We shall discuss m turn the following 
simple cases (Fig 8 11). 


FIGURE 8 11 
End conditions 
for a shaft 
vibrating tor- 
Bionally: (a) 
fixed-fixed, (b) 
free-free, (c) 
fixed-free 


-■ 1--)-1 


ib) C 

", 1 — 

a Both ends of the shaft are built-in, i.e , are constrained so 
that no twisting can take place 
b Both ends of the shaft are free to twist 
c One end of the shaft is built-in; the other is free to twist 

If both ends of the shaft are held fixed, we have the following 
conditions to impose upon the general expression for 0(x,O, assum¬ 
ing the x-axis chosen along the shaft so that the left end of the 
shaft IS at X — 0 and the right end is at x = 1: 

6{0,t) = = 0 identically m t 

Substituting i = 0 into the expression (2), we find 
=0 = C(A cos X< -h B Bin \t) 
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This condition will obviously be fulfilled for all values of i if both 
A and B are zero In this case, however, B{x,t) is zero at all times 
and the shaft remains motionless, a possible but trivial solution 
in which we have no interest Hence we are dnven to the other 
alternative, C = 0, which reduces (2) to the form 

B{Xjt) = D sin ^ X (A cos \t + B sin \t) 

The second boundary condition, namely, that the right end 
of the shaft remains motionless at all times, requires that 

B(l,t) =0 = 7) sin — (A cos \l B sin \t) 
a 

As before, we reject the possibility that A = B — 0, since it leads 
only to a trivial solution Moreover, we cannot permit 7) = 0, 
since that, too, with C already zero, leads to the trivial case The 
only possibility which remains is t hat 

. Xi . \l 

sin — = 0 or — - mr 
a a 

From the continuous inhnity of values of the parameter X 
for which periodic product solutions of the wave equation exist, 
we he”^ thus been forced to reject all but the values 

(3) X, = „ = 1, 2, 3, . 

These and only these values of X (still infinite in number, how¬ 
ever) yield solutions which, in addition to being periodic, also 
satisfy the end, or boundary, conditions of the problem at hand. 
With these solutions, one for each admissible value of X, we must 
now attempt to construct a solution which will satisfy the remain¬ 
ing conditions of the problem, namely, that the shaft starts its 
motion at < = 0 with a known angle of twist <l(x,0) = /(x) and a 
dB I 

known angular velocity ~ every section. 

Now the wave equation is linear, and, thus, if we have 
several solutions, their sum is also a solution Hence, writing 
the solution associated with the nth value of X in the form 

Bn(x,t) = sin -- X (An cos XJ -b sin XnO 
a 

. nrx ( . UTal . „ . nraAf 
= sin -j- (An cos —^-b Bn Bin —j-1 

it IS natural enough (though perhaps optimistic, m view of the 
questions of convergence that are raised) to ask if an xnjinite 


t The constants A and B now bear subsenpts to indicate that they are not 
necessarily the same in the solutions associated with the different values of 
The constant D can^ of course, be absorbed into the constants A and B 
and need not be explicitly included. 
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series of all the 0«*s, say 

* • / 

e{x,i) =* ^ dn(x,t) = ^ sin ^ f An 

n - 1 n - 1 ' 


nvat , n ■ nirat} 

cos —i-h Bn sin —j— 

i t j 


can be made to yield a solution fitting the initial conditions of 
angular displacement and velocity. 

This can be done, and in fact in this case the determination 
of the coefficients An and requires nothing more than a simple 
application of Fourier series, as developed in Chap 6 For, if 
we set < = 0 in we obtain from Eq (4), and the given initial 

displacement condition, 


0 ( 1 , 0 ) « f{x) = ^ An sin - 


The problem of determining the An's so that this will be true is 
nothing but the problem of expanding a given function f{x) in a 
half-range sine series over the interval (0,/). Using Theorem 2, 
Sec 6 4, we have explicitly 




nvx j 
sin —^ ax 


/ 

V • / 

1 “'‘x (- 

n-l ' 


. nirat , „ niraA tito 
A n sin -f Bn cos -y- J -J- 


Hence, putting ^ = 0, we have from the initial velocity condition, 




This, again, merely requires that the be determined so that 
the quantities 


will be the coefficients in the half-range sine expansion of the known 
function ^(x) Thus 


nra 2 fi , . 

r ^' = T jo 


mrx , 
sin -j- ax 


gix) si 


TlTX , 
Sin —j— ax 


Aside from convergence questions, our problem is now com- 
plet/ely solved We know that a uniform shaft with both ends 
restrained against twisting can vibrate torsionally at any of an 
infinite number of natural frequencies. 


2t “ 21 


cycles/unit time n = 1, 2, 3, . 


If and when the shaft vibrates at a single one of these frequencies, 
we know that the angular displacements along the shaft var; 
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periodically between extreme values proportional to 


Finally, assuming any initial conditions of velocity and displace¬ 
ment which satisfy the Dirichlet conditions, we know how to 
construct, at least formally,* the instantaneous deflection curve 
as an infinite senes of the deflection (‘urves assoiuated with the 
respective natural frequencies X„ 

The treatment of the shaft with both ends free follows closely 
the preceding analysis, once we obtain the proper analytic formu¬ 
lation of the end conditions To obtain this formulation, we 
observe that at a free end, although we do not know the amount of 
twist, we do know that ther(‘ is no torque acting through the end 
section Recalling from the discussion of Sec 8 2 the expression 
for the torque tiansmitted through a general cross section of a 
twisted shaft, wc thus find the free ends characterized by the 
requirement that 


ox end 


= 0 


Since is a nonzero constant of the material of the shaft and 
siiK'C . cannot vanish for a shaft of uniform section such as we 

de 

are considering, it follows that at a fre(‘ end ^^ ^ 

Returning to the original prodiK't solution (2), we find that 

— = f - C ^ sill ^ r -f ^ cos - (.4 cos \l + ff sin \() 

Sx \ a a a a / 

Substituting r = 0 and equating the lesull to zero, we obtain the 
eondition 


- D(A cos M + B sin \t) = 0 for all t 
a 


and from this wc conclude that I) ^ 0 Substituting x = I and 
again equating to zero, wc hnd 


— (! - sin {A cos \t B sin \i) = 0 
a a 

Since wc cannot permit ( —0, we must have 

sin - = 0 or nir 

a a 

Thus, as in the last example, to have the end conditions of the 
problem fulfilled, X must Vie lestrnted to one of the discrete set of 
values 


Xn = 


/ 


n = 1, 2, 3, 


* See the footnote to Example 2, Sec H 3 
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(5) 


(0) 


Again, we ronstruot the produ('t solution for eaeh admissiV)]e 
value of X: 

On(T,t) = ^oos ^ (^n eoa XJ + Bn sin XJ) 

nirx / . rnrat . „ 7nrat\ 

— cos —j- ( A „ cos ~j -h Bn sin - j 

and attempt to form an infinite senes of these solutions, 

d(r,t) = ) dn(x,t) - ) cos - I An cos + Bn sin ~j~ j 

n-l n = l ^ ^ 

which will satisfy the initial displacement condition 0 (j,O) = f(r) 

S6 I 

and the initial velocity condition ^ = g(x) 

nl li.o 

To satisfy the initial displacement condition, we, must have 
00 

0(x,O) ^ f(x) = ^ An cos ~ 

n- I 

which requires that the A,/a be the coeffi(Ments in Ihe half-range 

cosine expansion* of the known function /(/), that is, that 

. 2 fi ^ nwx , 

An = j fix) cos j- dx 

To satisfy the initial velocity condition, we must hav(‘ 

<9^ I . , V /\ VrKX 

which requires that the quantities 
nTra> „ 

T" 


be the eoethrients m the half-range cosine senes* for gix) over th(‘ 
interval (0,/), tJiat is, that 


^ jT' 0(J) CO. rf. 




TITTJ , 
COS - ^ dt 


We note in passing that, since the admissible X’s are the same 
for the free-free shaft and the hxed-hxed shaft, the natural fre¬ 
quencies of the two systems are the same The amplitudes through 
wViich they vibrate are not the same, however In fact, for the 
tixed-tixed shaft we found the distribution of amplitudes along the 
shaft given by the function sin (nirx//), whereas for the free-free 
shaft the amplitudes are given by cos {nwx/I). 

The ease of the shaft with one end hxed and the other free 


* In general, the half-range cosine expansion of a function begins with a 
constant term This senes does not, because we rejected earlier the possibility 
M =“ 0, which would iiave led to su^h a term Had there been an acceptable 
product Solution corresponding to ^ * 0 we would, of course, have had to add 
it to the solutions arising from the assumption ji — — X* when we construe* *d 
the infinite series for 6{x,i) (^e Exercise 1.) 
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can be disposed of quickly. Taking the fixed end at j = 0 and the 
free end at j = /, we have the two conditions 


0 ( 0,0 = 0 


for all t 


Imposing these upon the general product solution (2) gives 
C{A cos \t ^ B sin \i) =0 or C = 0 

and ^ D cos (^4 cos \t B sin \t) = 0 
a a 


from which v/e conclude that 
X/ _ X/ (2/1 — l)ir 
a a 2 


and finally 


(2n — l)air 


The general solution of the probleni, formed by adding together 
the product solutions corresponding to each X„, is therefore 


d{xA) = y sin — j- (i4n cos X„< Bn sin XJ) 
Lm a 


= 2 s" 


(2n — l)irj 


1^.4„ cos 


(2n — Diral , .. (2n — l)/raf^ 

O.- _ 


To fit the initial displaiemenr condition 0(j,O) — f{x), we 


must ave 


(2n — l)7rj 


This IS not (juite the usual half-range sine expansion problem, 
since the arguments of the various terms arc not integral multiples 
of the fundamental argument ttx/I It is, however, the special 
half-range sine exjiansion over (0,1) discussed in Exercise 13, 
Sec f) 3, where the formula for the coefficients was shown to be 




(2n — O/TJ j 
dx 


Similarly, to ht the initial velocity condition- 


we must have 


oM = 


n *■ 1 


(2n — l)wa 


Bn sin 


( 2/1 — l)/rz 


which requires that 


-T— 9(^) 

1 air k ^ 


(2n — l)7rj , 

- 21 - 


1 OiBcufls the restrictions implicitly imposed on f{x) and g{x) by the absence of constant terms 
in the senes in Eqs (5) and (6) What is the physical significance of these restrictions? 

^ Verify that the solutions of the wave equation ofitained in this section can all be written in 
the form 9(x,t) — F(x — of) + G(x 4 at), as required by the D’Alembert theory 
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Which of the following; equations can tie solved by the method of separation of variables? 
Where possible, detenu mo the product solutions 


dhi 
dx dp 
d^U 


-f bu - 0 


du 


+ b -— + c - 
(ix^ dx Oy dy 


dhi 

i -(- h - 

dx dy 


a^u 

dy^ 


0 

ES 0 


dhi dhi 

X*- y — “0 

dx^ dy^ 

d^U d^U d^U 

a — 4- b-h c —- = 0 

dx^ dy^ dz^ 

d*u d^u du dv 

a -1- h - hr -1- d — 

dx^ dy^ dx dy 


0 


4 A uniform shaft, fixed at one end and free at the other, is twisted so that each cross section 
rotates through an angle proportional to the distance from the fixed end If the shaft is 
released from rest in this position, find its subsequent angular displacement as a function 
of X and t 

6 A uniform shaft, fixed at each end, is twisted so that each cross section rotates through an 
angle proportional to x{l - x) where / is the length of the shaft and x is the dislame from 
the left end If the shaft is released from rest m tins position, find its subsequent angulai 
displacement as a function of x and t 

6 A uniform shaft, free at each end, is twisted so that each cross section rotates tlirough an 
angle proportional to (2j — /)/2, where / is the length of the shaft and j is the distance 
from the left end If the shaft is released fiom rest m this position, find its subsequent 
angular displacement as a function of x and / 

7 Shnv^ that the natural frequencies of a uniform string are given by the formula 

= — \f~' cycles/unit time 


w'here 1 is the length of the string, T is the tension under which it is stretched, and tc is its 
weight per unit iengtti How' does doubling the tcuision affect the pitch of thc> fundamental 
tone of the string? W'hy is it that most string instruments c'lther have strings of different 
lengths or have the lengths of their strings cluingc'd by the performer as he jilays*^ 

8 A uniform string, stretched bc'tween tlic points (0,(1) and (/,0), is given the mitiiil dis¬ 
placement 

i l 

X ^ 4 

I - X < X < I 

2 


9 


10 


and released from rest Find its subsequent displaceme nt as a function of j and I 
While m its equilibrium position, a uniform string, stretched between the points (0,0) and 
(f,0), IS given the initial \elocity 

I T ^ < 4 

J 

I - X - < X < J 
2 


Find its subsequent displacement as a function of x and i 

While in its equilibrium position, a uniform string, stretched between the points (0,0) and 
(/,0), IS given the initial velocity 


0 < T < 


I - k 


V(x,0) » g{x) 


1 I — k ^ k 

1 1 ^ ^ 


I -hk 


< X < I 
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Find its subsequent displacement as a function of a; and f Does your answer appear to have 
a meaningful limit as A; —* 0? If so, to what problem do you think it is the answer? 

11 A uniform string, stretched between the points (0,0) and (/,0) is given the following initial 
displacement and initial velocity 


12 


13 


14 

16 


y(x,0) = fix) 


y{x,0) = (j(t) 


rx 

sin ~ 


0 

< 

X 

< 1 




1 

< 

z 

< 

4 




3i 

< 

X 

< 

— 


< I 


Find its subsequent displacement as a function of x and / 

The curved surface of a rod of lengtli / is perfiH'tly insulated against the flow of heat The 
rod, w'hich is so thin that heat flow m it can be assumed to be one-dimensional, is initially 
at the uniform temperature 100“ Find the tenijirature at any {xunt m the rod at any 
subsequent time if both ends of the rod arc kept at the tcmpeiature 0° (Hint For heat 

dhi \ 

flow m one dimension, the heat equation reduces to - =* a* I 

dx^ dt ) 

Work Exercise 12, with both ends ol the rod insulated and the initial temperature dis¬ 
tribution in the rod given by 


M(r,0) = j{x) “ Wo 


0 < j- < / 


w’here x is the distance from the left end of the rod (Hint The temperature gradient 
through an insulated surface must be 0 ) 

Work FJxercise 12 with the left end of the rod maintained at the constant temuerature 0“ 
and the right end perfectly insulated 

Show that the torsional vibrations of any uniform hxed-free sliaft of length / are always the 
same as those of the left half of a suitab)}'^ ehosen fixed-fixed shaft of length 21 Is the con¬ 
verse true? That is, does the motion of the left half of a fixed-fixed shaft of length 2l alw'ays 
represent a possible motion of a fixed-free shaft of length /? 


8.5 

Orthogonal functions and the general expansion problem 

The three examples we ronsidered m the last section embody all 
the significant features of the general boundary value problem 
However, they give an exaggerated picture of the role of Fourier 
series in the final expansion process that is required in order to fit 
the initial conditions In general, a knowledge of Fourier senes, as 
such, will not suffice to obtain the necessary expansion Hence 
before we attempt to summarize the major characteristics of 
boundary value problems, as illustrated in our examples, we shall 
consider an additional example or two m which Fourier series play 
no part. 

EXAMPLE 1 

A Blender rod of length I has its curved surface perfectly insulated against the flow of heat Its 
left end is maintained at the constant temperature w ■* 0, and its right end radiates freely into 
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air of constant temperature w = 0 If the initial tennp<*rature distribution in the rod is given by 
i/(x,0) = fix) 

find the temperature at any point of the rod at any subsequent time. 

Since the rod is vciy thin and since its lateial surface is perfectly insulated, we shall assunu' 
that all points of any given cross section are at the same temperature and that the How of he,it 
in the rod is, therefore, entirely in the j-direction Thus we have to solve the heat equation 
(Eq n4), Sec 8 2| specialized to one-dimensional flow^ without heat sources* 


( 1 ) 


d^u du 

— = — 

6i 


At the left end of the rod we have the obvious fixed-temperature condition utO,0 = 0 At jlie 
right end wc have a radiation condition which must be formulated analytically before wo enn 
proceed with our solution 

Now, according to Stefan’s law, the amount of heat radiated from a given area dA in a 
given time interval dt is 

dQ = - Uo*) dA dt 

w'here U and aie, respectively, the absolute temperatures of the radiating surface and of Mir 
NU' oiinding medium and a is a proportionality constant This quantity of heat must have ( (ipk' 
to tlic surfa-'c by conduction from the interior of the body, hence, we have as a second tslimau 
for dQ the expression 

dll 

dQ - -k — dA' dt 
an 

aV 

where k\* the therniaJ conductivity, — is the temperature gradient in the direction perpiMidu u- 

On 

' It to dA, and dA' is an element of area, congruent to dA, situated in the body an infinittvsinii'l 
distance fTcm dA in (he normal direction Therefore, equating the twu) expressions foi dQ, wc 
have 

dU 

-k — dA' dt = <r(U* - Uo*) dA dt 

dn 


or, canceling the common factors and expanding L'* — in powers of — f ’o, 
-k - - = a([(r7o -h {(I ^ - fVl 


- - To) T ^U,HU - f ] 

Finally, if f - is small m comparison with ’^o, as we shall suppose, w*e can neglect ev'^ry- 
thing on the right except the first term, getting 


aU 

(Iv 


hiU - Uo) 


4trf/o« 

k 


n our problem, the normal to the surface from which radiation takes place, i e , the right end 
e rod, is tlu x-axis Hence if we measure tenqieratures from (/o os a reference value, so rhat 
w f n, our second boundary condition becomes simply 


heat equation aV a«^"uming a product solution u - XT and substituting it into tl>c 


y"T 3= niVT' 
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Dividing by XT, we have 



from which, Bince i and i are independent variables, we conclude that 

X" ^ T 

- and a.- 


must equal the same constant, say /i 

If M > 0, say' fi “ X*, we liave, from the fraction involving T, 

r ^-T and T = 

a" 


But this IS absurd, since it indicates that the temperature a => XT imToases b» yond all bounds 
jii? i irureases. Hence we reject the possibility that fi > 0 
If ^ =- 0, we have simply 

X'' « 0 r' - 0 

X = Aj- -h B r - 

und, letting (7=1, as we can without loss of geneu.lii.y, 
u » XT ^ Ax -h B 

For this to be relevant to our problem it must reduce to 0 when r = 0, hence /i *= 0 Moreover 
it must satisfy Kq (2) when r = /, heii(*e A = 0 7’hus /u — 0 leads only to a trivia) solution 
and must also be rejt cd 

Finally, if m < 0, say p = - X^, t he eomponenl dilTerential equations and their solutions arc 
X'' = -X^X 7’' = - ^ T 

X A cos \T B sin Xr T - Ce 

and, again letting T = 1, 

V = XT “= {A rofl Xj + If am Xj)e~^*‘'“’ 

To lit the left end condition we must have u((),n hf 0 “ Hence >1-0, and n reduces 

to u = /jf, mn \x To ht the right (Tid condition (2), we must have 

cos X/ = sin X/ 

or, dividing out the exponential and collecting terms, 

B(h si’i X/ -f- X (OS X/') = 0 

If 7^ = 0, the solution is trivial Hence we must have 


or 

or finally 
where 


h sin X/ -f X cos X/ = 0 

X \l 

tan X/ = — - = — T", 
n hi 

tan 2 = — az 
2 — X/ and a “ 


J. 

hi 


This equation is not like the simple equations 
sin X/ — 0 and cos X/ - 0 


which detennined the admissible values of X in the examples of the lost section, and its roots 
cannot be found by inspection. To determine them it is convenient to consider the graphs of the 
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two fiinctioiifl 

y\ “ tan z and f/i — —az 

The abBcifisas of the points of intersection of these curves (Fig 8 12), being values of z for which 
Vi ” Vi, arc then the solutions of the equation 

tan 2 “ — «z 

Obviously, there are an infinite number of roots z„ However, unlike the roots of sin \1 = 0 and 
cos XZ — 0, they are not evenly spaced, although, as the graph in Fig 8 12 indicates, the interval 
between successive values of z„ approaches v ss n becomes infinite 

From each root z»,, we obtain at once the corresponding value of X 



and the associated product solution 

w„(x,0 * T„(t)XJx) » sin Kx 

Then we form a series of these particular solutions 

00 GO 

(3) u(x,0 = ^ Un{x,t) « ^ sin X„x 

« — 1 n — 1 

and attempt to determine the constants Bn so that the function defined by the senes will satisfy 
the initial condition 

w (a:,0) - fix) 

Finally, putting Z — 0 in (3), we find that this requires 

(4) u(x,0) ■ fix) “ ^ sin X*x 

n -1 

Thus, as in the examples in the lost section, to satisfy the initial condition we must be able 
to expand an arbitrary function in an infinite series of known functions, determined by a differ¬ 
ential equation and a set of boundary conditions However, although the functions in terms of 
wipuch the expansion is to be carried out are sines, the values of X appearing in their arguments 
ore ittpaced at incommensurable intervals, and so the required senes la not a Fourier series 
Clearly, something is involved which includes Fourier scries as a special case but is itself more 
genelral and more fundamental. 
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If we review thoughtfully our earlier discussior of Fourier 
series (Ser 6 . 2 ), it should be apparent that the decisive property 
of the set of functions {cos {nwx/l), sin (nirx/l)] which made it 
possible to determine one by one the coefficients in the assumed 
expansion 

// \ I I irX . . 

f{x) = - tto -f Ui cos -jj- -f 02 cos —^-h ■ • 

I 1 . j 2 vx . 

+ bi sin y -h 62 sin + ■ • 

was that the integral of the product of any two H'stinct members 
of the set taken over the ap])ropnate interval is zero For it was 
this that enabled us to multiply the series for f(x) by cos nn/l 
or sin mrx/l and eliminate all bin, one of the unknown coefficients 
simply by integrating from d \u d 21 

Now, sines and cosines im by no means the only functions 
from which sets can be constructed having the piropertv that the 
integral between suitable limits of the product of two distinct 
members of the set is zero In fact, the trigonometric functions 
which appeal in I'ourier expansions are riKirely one of the simplest 
examples of inhnitely many such systems of functions, whose 
existence we shall soon establish 

DEFINITION 1 

If a sequence of real functions 

{4>r.{x)\ n = 1,2,8, 

which are defined over some interval (a,6), hnite or infinite, has the property that 

^ (t>^(x)4>n(x) dx 

then the functions are said to form an orthogonal set on that interval 

DEFINITION 2 

If the functions of an orthogonal set (<^„(x)| have the property that 
(t>J(x) dj = 1 for all values of n 

then the functions are said to be orthonormal on the interval 

Any set of orthogonal functions can easily be (“onverted into an 
orthonormal set In fact, if the functions of the set are 

orthogonal and if /c„ is the (necessarily positive) value of 

<t»n‘Kx) dx, theri the functions 

4 >i(x ) »2(x) 

V^/ti -y/ki y/kz 

are clearly orthonormal. It is, therefore, no specialization to 
assume that an orthogonal set of functions is also orthonormal. 


1=0 m ^ n 

I 5^ 0 rn = n 
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DEFINITION 3 

If a sequence of real functions has the property that, over some interval 

(o,6), finite or infinite, 

f p(r)<^„(x)*„Wrfx j - J 

then the functions are said to be orthogonal with respect to the weight function 
p(x) on that interval. 

Any set of functions orthogonal with respect to a weight function 
p(x) can be reduced to a system orthogonal in the first sense 
simply by multiplying each member of the set by y/p(x) if, as we 
shall suppose, p(x) ^0 on the interval of orthogonality 

With respect to any set of functions l<#>n(j:) 1 orthogonal over 
an interval {a,b), an arbitrary function/(x) has a formal expansion 
analogous to a Fourier expansion, for we can write 

( 5 ) f(x) = -f an<l>u{x) -f 

Then, multiplying by <^n(x) and formally integrating between the 
appropriate limits, a and b, we have 

fix)<l>n{x) dx = ai (f>iix) 4 >n{x) dx 

+ a2 <l>2ix)(pn(x) dx -f + 

From tho property of orthogonality, all integials on the right are 
zero except, the one which contains a square in its integrand 
Hence, we can solve at once for an as the quotient of two known 
integrals' 

fVW0n(x) dx 

- 

(t>n^ix) dx 

However, although the orthogonality of the 0’s makes it possible 
to determine the coefficients in the expansion (T)), this property 
IS not sufficient to guarantee that this senes convexges to fix) or 
even converges at all. 

To pursue this matter a little further, it is convenient to 
introduce the idea of a null function: 

DEFINITION 4 

A real function fix) is said to be a null function on the interval (a,/>) if 
P{x) dx = 0 

If fix) 18 identically zero, it is obviously a null function How¬ 
ever, a null function need not be identically zero In fact, since the 
area under a curve is not altered by changing the ordinate of the 
curve at one or more isolated points, it is clear that we can have 
r f (i) dx = 0 even though/(x) has nonzero values at a finite or 
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countably infinite number of points between a and b On the other 
hand, if there is any subinterval of (a,6), no matter how short, at 
all points of which/(i) is different from zero, then ^ p{x) dx ^ 0 

and/fx) is not a null function F'rom this it is not difficull to show 
that a null function is zero at every point where it is continuous 
Clearly, any null function is orthogonal to every member of 
an orthogonal set j<^„(j)| It is conceivable, also, that a nonnull 
function /(jr) might be orthogonal to every 0, that is, that v ' might 
have 

fb 

dx = 0 for all values of n 

In such a ease, every coefficient in the expansion of/(j ) m terms of 
the <f>’s would be zero, and the KTies (fi) would converge to zero at 
all })Oints of (a, 6) even though/(u*) was not a null function That 
this IS actually possible is eiiMly shown by example. F'or instance, 
although the functions {sin n r| are readily vshown to V)o orthogonal 
over the interval (- 7r,Tr), not every tunction can be icjiresented on 
this interval by a series of tlu* form 


ui sin X -h a2 sin 2 x -f -f an sin nx + 


In particular, if/(r) = we have, for the coefficienis in its for- 
K^al expansion, 

/ x'^ sin nx dx 

an = - 

r sin^ nx dx 


]\ 2 x /x2 2\ > n 

= - —7, Sin nx — [ ~ \ -, I cos nx =0 

TT L n-' \n^ rry 


for all values of n More gen(‘rally, since every member of the set 
(sin nx] IS odd, it is clear that no senes of these functions can 
represent any even function on the interval ( — 7 r, 7 r) 

Evidently, important as it is, orthogonality is not the whole 
story, and the functions in our orthogonal systems must possess 
some further property before the expansion (5) (^an be used with 
confidence What is rc^quired is that the set of functions (0„(x)|, 
in addition to being orthogonal, should also possess the property 
of completeness described m the following definition 


definition 5 

A Bet of orthogonal functions {^^(x)] is said to be complete if the relation 
/ /(^) 07 i(x) dx = 0 can hold for all values of n only if f{x) is a null function 

If (0r,(j)( IS a complete orthogonal set, then clearly not all coeffi¬ 
cients in the expansion of a nonnull function can be zero, and thus 
no nontrivial function can have a trivial expansion. In fact, we 
have the following theorem. 
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THEOREM 1 

If the formal expansion 

+ a24^2(x) + • ' an 4>n(x) ’ 

of a function/(j) in terms of the members of a complete orthonormal set {0n(x)] 
converges and can be integrated term by term, then the sum of the series differs 
from/(x) by at most a null function; that is, the sum of the series cannot differ 
from f(x) over any interval of finite length 

«o 

PROOF By hypothesis, the series ^ an 4 >nix) converges to some function, 

n — 1 

hence, it is meaningful to consider the difference 

m 

g{x) = fix) - 5 ) an<t>„ix) 

n — 1 

If we can prove that g(x) is a null function, the assertion of the theorem will be 
established To do this, consider 

4 »m(x)g{x) dx = 4 >„{x) [/(x) - ^ an</>n(x)] dx 

n-l 

= 4 >m{x)fix) dx - 0„(x) ^ an<t>n{x)^ dx 

71 1 

= <t>m(x)f(x) dx - ^ an <l>m{:x)ii>n{x) dx 

n-l 

— Om a^i 

=i= 0 m = 1 , 2 , 3 , 

Hence, g{x) is orthogonal to every one of the 0 ’b Therefore, since the <t >^8 form a 
complete set, g(x) must be a null function, and the theorem is established 

Closely associated with the concept of completeness is the 
concept of closure* described in the following definitions 

DEFIN ITION 6 

fb 

If lim l/(x) — Sn{x)]^ dx = 0, the sequence of functions Sn{x) is said to con¬ 
verge in the mean to fix) 

DEFINITION 7 

If Sn{x) = ai<i>i{x) -h a24>2{x) -h -I- an 4 >n{x) IS the nth partial sum of the 

expansion of /(x) in terms of the members of an orthonormal set and if 

Sn{x) converges in the mean to/(x) for every /(x), then the set l^„(x)) is said to 
be closed 

One important property of closed orthonormal sets is con¬ 
tained m the so-called theorem of Parseval: 


What we have called completene 98 some authors call closure^ and vice versa. 
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theorem 2 

If ai0i(x) + a 2 ^ 2 (x) + -h an4>n(x) + is the expansion of a function 

fix) in terms of the members of a closed orthonormal set then 

J = l'p(x)dx 

n = 1 

PROOF From the definition of closure, we have 

PI 

/*[/(!) - ^ - 0 

7J =■ 1 

m Tti 

or lim [ l/(-r)C - 2/(x) ^ a„<t>„{x) + { ^ J' j dx = 0 

n ■“ 1 T> ” 1 

If we now perform the indicated mtegralion, remembering that 
£ f(x)^t,(x) dx = a„ 

and observing that, in the integral of the last term 

i :.. \<1 

m m 

I [f{x)\^ dx - 2 ^ -f ^ a„2j =0 


we obtain 


lim 


I an‘ = l'[f{x)Vdx 


as asserted 


As an immediate consefjuence of the last theorem, we have 
the following important result 


THEOREM 3 

A closed orthonormal system j<^n(j")| is also complete 

PROOF To prove this, let us suppose that the closed orthonormal system 
( ^Pnix )) is not complete This implies that t here is at least one nonnull function/(a:) 
which IS orthogonal to each of the 0’s and which, therefore, has the property that 
every coefficient in its expansion in terms of the 0's is zero However, since the 
set ( 0 , 1 ( 1 )I is closed, we have, from Parseval's theorem, 

l^Pix) dx = \ 

n = 1 

Hence, since each a„ is zero, as we have just observed, it follows that /(x) is a null 
function, contrary to our assumption. This contradiction forces us to abandon the 
supposition that the closed set | 0 „(j) ! is incomplete, and the theorem is established 

The converse of Theorem 3 is also true, but the proof of this 
fact 19 difficult, and we shall not attempt it 

A great deal of important advanced mathematics deals with 
the properties of special orthogonal systems and with the validity 
of the formal expansion we have just created. In the next chapter 
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we Rhall cxatuine in some detail two sueh systems, namely, the 
Bessel functions and the Lep;endre polynomials Questions con¬ 
cerning the convergence of the generalized h'ouner series (5), how¬ 
ever, we shall not discmss, and in oui work we shall assume not 
only that all lh(‘ expansions we obtain converge but also that they 
actually represent the functions which generated them 

Orthogonal functions arise naturally and inevitably in many 
types of problems in pure and applied mathematics * Their 
existence in problems such as we have been considering is guaran¬ 
teed by the following beautiful and important theorem t 


THEOREM 4 

(liven the differential equation 



-h [qM + XpW]?/ = 0 


where r(x) and p{x) arc continuous on the closed inteival a ^ x ^ h and r/(x) is 
continuous at least over the open inteival a < x < b If Xi, X 2 , X.^, . are the 
values of the parameter X for which there exist solutions of this ei]uation possessing 
continuous first deiivatives and satisfying tlie boundary (‘onditions 

axy(a) - a 2 t/{a) = 0 
bivib) - b^y'ib) ^ 0 

where a^, 02 , bi, b^ are .tny constants such that Ui and a 2 are not both zeio and bi 
and 62 are not both zero, and if i/n 1/2, y \, • are the solutions corresponding to 
these v^alues of X, then the functions j i/n(x) 1 form a system orthogonal with lespect 
to the weight function p{x) ovei the interval (a,b) 

PROOF To prove this, let i/m and i/„ be the solulions associated with tuo 
distinct values of X, say X^ and Xr, This means that 

"‘S"'+(*+-» 

+ (9 + Kp)!/~ = 0 


Now multiply the first of these ecjiiations by Pn and the second by //m and then 
subtiaet the second eijuation from the first. The result, after transposing, is 


{K - K)pymyn 


diryj^ _ d{ry'J 

" dx dx ' 


or, integrating between a and 6 , 



py^Vn dx = 




, d{ry^ 
dx 




dx 


* It IS mterestitig and instructive in this connection to reread the discussion 
of orthogonal polynomials in Sec 4 6 and to refer to the discussion of the 
orthogonality of vectors in Sec 10 4 

t This thfyjrem and the boundary value problem with which it deals are 
usually associated with the names of the Swiss mathematician J. C F. Stun 
(1803-1^55) and the French mathematician Joseph Liouville (1809-1882 
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If we can prove that the integral on the left vanishes whenever m and n are differ¬ 
ent, we shall have established the orthogonality property of the functions of the 
set \yM\- This we shall prove by showing that the nght-hand side of the lost 
equation is zero To do this we begin by integrating the terms on the right by parts 



dx - 

11 l/m 

dv~d(rv„') 

ry^Vn 

du “I/m' dx 

F »ri/n' 




rynyln 

«-l/n 

du - v„' dx 

= d(rj/ m') 
F “ rj/Bi' 


- ry'^yL dx 

- ry'„y'„ dx 


When we subtract these expressions, the integrals which remain on the right 
cancel, and we have 


( 0 ) 




d{ry'J 




dx = r{y„.v'„ - y’r^yn) 


b 

a 


Now Hm and ?/„ are not merely solutions of the given differentlat equation t^or 
every m and n, they also satisfy the boundary conditions 


a\y{a) = a^y'ia) and hiy{h) - 


f^ubstit/Uting for y'{a) and y'{h) from these expressions into the evaluated anti- 
clenvative in ( 6 ), we obtain 



= rib) y„(b) - j 


- r(a) i/„(o) - ?/„(o) - ~ y„(a)y„(a) 
(12 (*2 


0 


If 02 or 62 , or both, should be zero, this result can still be established by substitut¬ 
ing for y(a) or y{b), or both, instead of for their derivatives, since Ui and 02 cannot 
both vanish nor can bj and 62 ]\ToreoAan\ if r(a) — 0 , then the first boundary 
condition becomes irrelevant, that is, the integrated terms vanish at x = o with¬ 
out the need of any condition on the solutions y^ and Likewise, if r(b) = 0, 
the second boundary condition is irrelevant We have thus shown that under the 
conditions of the theorem 


(\„ - \„) py^y, dx = 0 

Since X„ and were any two distinct values of X, the difference X„ — X„ cannot 
vanish Hence 

pymVn dx = 0 

and the theorem is established 


In each of the torsional vibration problems we considered in 
Sec 8 4 , the functions in terms of which we had to expand the 
initial conditions satisfied a differential equation and a set of 
boundary conditions included under Theorem 4. This, and not 
the coincidental fact that P'ourier senes were involved, explains 
w'hy the final expansion could be earned out in each case 
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EXAMPIE 1 (continMed) 

When we left Example 1 in older to develop the theory necessary to complete its solution, we 
were faced with the necessity of expanding the initial temperature ?y(x,0) = f(x) in a senes of 
the form (4), 

/(x) ^ B„ sin 

n = 1 

where the functions (sin X„x} were the solutions of the differential equation 
X" -f- x*jr - 0 
which satished the conditions 


X{0) - 0 
hX(I) -f X'(0 = 0 


But this equation and the accompanying boundary conditions are in all respects a special case 
covered by Theorem 4 In fact, with X^ written in jilacc of X, we iiave 

r(x) = 1 q(x) “ 0 p(x) -» 1 

a “ 0 b — I 

ai I 02 = 0 bi — h hi = -1 


Hence, by the lost theorem, the functions {sin X„xl form n set orthogonal with respect to the 
weight (unction p(j) =* 1 on the interval (.0,/) 

To determine Bn w'^e now multiply Eq (4) hy sin XnX and formally integrate from 0 to / 
Because of the orthogonalit’' of the functions sin X„j, every integral on the right vanishes except 
the one wdiose integrand containa sin’ X„x Therefore, 




sm XnX dx 




sin2 X„T dx 


or, evaluating the integral in the denominator and recalling that z„ — \J satisfies the equation 
Bin Zn = —aZn cos Zn, 


Bn “ 


_ 2 _ 

l(l -f a COS^ Zn) 



sm X„j dx 


With Bn determined, the formal solution is now complete 


Problems involving second-order differential equations are 
not the only ones in which orthogonal functions arise In par¬ 
ticular, we have the following important theorem covering fourth- 
order systems, of which the vibrating beam is a special case 


THEOREM 5 

Given the differential equation 


dMx)y"] 

dx‘^ 


+ [g(x) -h \p{x)]y = 0 


W%ereV(j) and p(x) are continuous on the closed interval (a^b) and q{x} is con¬ 
tinuous at least on the open interval (a,6), If Xi, X 2 , Xs, . . are the values of 

the. parameter X for which there exist solutions of this equation possessing con 
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tinuous third derivatives and satisfying the boundary conditions 

Oi2/(o) — ai{ry'y = 0 (i2y'{a) — a^iry") = 0 

biy{b) - ^i(ry'y I = 0 b^y'ib) ~ ^ 2 {ry") 1=0 

I*' (o 

where neither a, and nor b* and arc both zero, and if yi, ^ 2 , 1 / 3 , are the 

solutions corresponding to these values of X, then the functions (iyn(j)| form a 

system orthogonal with respect to the weight function p{x) over the interval 'a,b) 


EXAMPLE 2 


A uniform cantilever of length I begins to vibrate with initial y(x,0) ^ jix) and 

dy I 

initial velocity — = Find its displacement at any point at any subsequent time 

dt ]x,0 


For definiteness let us assume that the built-in end of the benrn im at t he origin Then, since 
the beam is of uniform cross section and bears no external load, we la'.e to solve Eq (11), 
Sec H2, 

“ dx* "" 


subject to the boundary conditions 


2/(0,t) = 0 

-0 


dx I 

I 


0 


d*y 

dx* l,t 


= 0 


j e , the displaiauiieiit at the built-in end is zero 
1 e , the slope a(. the built in end is zero 

i.e , the moment KJ — at the free end is zero 
dx^ 


i e , the shear - — at the free end is zero 

ax 


As usual, we begin by assuming a product solution y{3 .1) = X{x)T{l), substituting it int-o 
t he given partial differential equation, getting a>A = - XT", and then separating variables, 

XIV r" 

o* —— -- - 


Since X and t are independent variables, these two frections must have a common constant 
value, say m If m ^ 0, the solution for T cannot be periodic, as we know U must be to represent 
undamped vibrations Hence we restrict /* to be positive,* and write /x ■» X* This leads to the 
component differential equations 

T" = -x*r and 
and the respective solutions 


(7) 

T - A COB 

Xf -f B Bin U 

(8) 

X -» Ceos 

X D sin X + E cosh x F sinh x 


* In vibration problems where it is clear that only periodic solutions are 
possible, engmeers often take their initial assumption to be 

yix,l) = Xix){A COB XU- B sm U) 

as, in effect, we did in Example 3, Sec 6.5, in studying the undamped vibra¬ 
tions of an electrical network with only a finite number of degrees of freedom. 
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r Hin z — D cos z E sinh z F cosh 2 — 0 
If we eliminate C and D from these equations by usin^ the conditions 
-f 2? - 0 and ]) ^ F ^ 0 

we obtain the system 

(10) K(roBh z -b cos z) + F(sinh z + sm z) = 0 

fi^(Bmh z — Bin z) + F(cosh z -f cos z) = 0 

These equations w ill have a nontrivial solution for f] and F if and only if the determinant of the 
coefficients is equal to zero Ilrnce we must hR\e 

coflh z -b cos 2 sinh z -b sni z 

- 0 

sinh z — sin z cosh z -b cos z 
or, expanding and simplifying, 

cosli z cos z — 1 

The existence of mhnitcly many roots of this equation, ic, cos z == —l/cosh z, can be 
inferred from Fig 8 13, where the graphs of 

y ■■ cos« and y — - 

cosh z 


are plotted. 
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figure 8 13 
Plot showing 
tho graphical 
h<»lution of the 
equal ion 

eos ^ = — l/c'osh 2 r. 



tos}) C 


htom these roots z^, zj, , \\(‘ ean find tlie relevant values of \ at once from Kt] (9) 


When z has anj'' one of the valu(‘s Zj, r>, Za 
we ean vi nte (itfur 


, the equatioTif (10) l)C('ome dependent, and 


hinli z f sin z 
eosh 2 4 eoH z 


( Osh 2 ) eos z 

sinh z - Rin 2 


as we elioose Using the formi'r, we have 

ft-’n = — Un = -- (sinh 2n f Sill Z„) K „ 

/'n = — Dn — (eosh 2„ + eos 2„)fC„ 
where K„ is an ailutr"'y constant ’l'h(‘ri fore, c>ul>stituting into I'>i (8), 


A4(r) = ('n loa yjj -f 1 /'/,i eosh j fsnili j 

/ J* V 

l 2„) I eos Zn - eosh Zn , 1 

\ ' V 

/ ^ 1 
2 „) I sin z„ ^ — sinh Zn j j 


/Vnfsinh 2 „ 4 sin i 


— rth osl) Zn 4 eos 


Hence, ahsoihing A4 in the eoefhcjcnls and /f„ in the expression (7) for 7’n and nalehmng V„ 
to lie tin completely dc-UTinmed fuin lion 


(llj 


Xn(i) = (sinh 2„ d sin zj ^eos 2„ , - eosh 2„ ^ 


( 


- (eosli 2„ 4 eos 2 „) j^sm 2„ ^ — Hinh 2„ ^ J 

we hove, as the formal solution of the partial ddleiential ecpiation whnh meets the four given 
houndary conditions, 

as «> 

y{T,t) = N An(r)7\,(/) -- ^ A4(j-)(d,. eos 4 /fn sm XnH 
n-l 

To satisfy the initial displaeemenl condition, we must have 
v(-r,n) ^ f(j) = ^ 4„A„(j) 

» = l 

and to satisfy the initial velocity condition, we must have 


(13) 


dy 

at 1,0 


^ g(x) 
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Thus, again, to satisfy the initial conditions we must be able to expand an arbitrary function 
m an infinite series of kiiown functions, in this case the functions of the set |Xn(j)) defined by 
Eq (11). These bear little or no resemblance to the terms of a Fourier series, but the required 
expansions can easily be carried out using the orthogonality of the An’s, which is guaranteed by 
Theorem 5 (and of course their completeness, which as usual we must assume) In fact, with 
xVa® written in place of X, our problem is just the special case of Theorem 5 for which 

r(z) ” 1 q(x) = 0 p(x) “ 1 
o » 0 6 = / 

a, » 1 = 0 b, - 0 -1 

02 = 1 a2 = 0 ^2 *" b /32 — 1 

Hence, the functions of the set (A'„(x)l are orthogonal with respect to the weight function 
p(x) ™ 1 i'ver the interval (0,/) 

With the orthogonality of the X„'8 now established, wo can determine and imine 
diately by multiplying Eqs (12) and (13) by A"n(x) and integrating from 0 to / The results arc 

f f{x)X„{x) dx f g{x)Xn(x) dx 

An = - and Hn » - 

Xn^ix) dx K I Xn*{x) dx 

We are now in a position to summarize the main feature- 
of a simple boundary value problem By assuming that sohiiioiis 
for the dependent variable exist in the form of products of funi- 
tions of the respective independent variables, the original differ¬ 
entia' equation is broken down into several ordinary differeniuil 
equations, each of which involves a parameter X which ranges 
over a continuous infinity of values 

When the boundary conditions of the problem are imposed 
upon the product solutions obtained by solving the component 
ordinary differential equations, it is necessary, in order to avoid 
solutions which are identically zero, that the parameter X satisfy 
a certain equation. This eiiuation is known as the characteristic 
equation of the problem, and its roots, in general infinite in 
number, are known as the characteristic values or eigenvalues 
or Eigenwerte* of the problem. Only for them can solutions be 
found sati.sfymg both the partial differential equation and the 
given boundary conditions. In a vibration problem, the char¬ 
acteristic values determine the natural frequencies of the system, 
and the characteristic equation is therefore usually called the 
frequency equation. The solutions which correspond to the 
respective characteristic values are known as the characteristic 
functions or eigenfunctions of the problem. In a vibration prob¬ 
lem, they are usually called the normal modes, since they dehne 
the relative amplitudes of the extreme positions between which 
the system oscillates when it is vibrating at a single natural 
frequency, i e , in a “normal” manner 

To satisfy the initial conditions of the problem it is necessary 
to be able to express an arbitrary function as an infinite series 
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of the characteristic functions of the problem This can be done 
m most cases of interest because under very general conditions 
the characteristic functions of a boundary value problem form 
an orthogonal set over the particular interval related to the 
problem. 

EXERCISES 

1 Tf 1 (a) “ r(h), show that thf‘ ronclusion of Thooroni 4 follows equally well if the boundary 
conditions are of the form 

y(a) = i/(b) and y'(a) =- i/'(h) 

2 \ enfy by direct integration that the chararten^lic functions of Kxariple 1 are orthogonal 
o^er the interval (0,0 

3 In Kxample 1. if a = 1, compute the values of ?i, z-,, and "i, and d etermine the first three 
cfiefficjcnts in the expansion of the initial condition i/fj-.l)' - fix) = t 

4 In Example 1, if the left end of the rod is perfeetly insw*. led, determine the eharactenstir 
equntion, show that it has infinitely luanv rool^l, and pi ‘Ve that z, - Zn approaches tt as 
71 becomes infinite 

6 I'uid the temperature iiijrJ) in a slender rod of length 1 v ho.se curved surface and left end 
ue perfectly insulated and w'ho.se right eml ladiates freely into an of constant temperature 
o’ if the rod is initially at the temperature 100" throughout 

6 fn Kxample 1, if both ends of the lod ladiate ficely iiOo air of constant temperature O", 
determine the characteristic equation, .show that it has mfir.itely many roots, and piove 
that H — z„ approat s tt as n becomes infinite 

7 A slender rod of length I has its curved surface and left end perfectiy insulated Its right 
end radiates freely into air of constant temperature 70" Initially llie temperature through¬ 
out the rod is 100" Find the temperature ol the rod as a fuindion of x and t (Hint Let 
I' — u — 7{) be the dependent variable ) 

8 Work Example 1 with the left end of tin* rod maintained at the constant temperature 100" 

9 Prove Theoiem 5 

10 Prove that the general linear beeond-oider differential equation 

Po(x)y'^ + Pi(j')y' + Pii(j^)V = At/ 

can be ieduced to an equation of the Slurm-Liouville form (see d hcorein 4) by multiplying 
it by the factor 

1 f ^ [p ix) / po(j:)]dx 
. eJxo 
Pq(^) 

11 1' ind the frequency equation and the normal modes for the transverse vibration of a uniform 
beam whose ends are 

a Hinged-hinged (Hint A hinged end is one where a beam, though constrained so it can¬ 
not deflect, IS still free to turn, i e , an end where both the displaiement and the moment 
aie zero at all times A hinged end is often referred to as a simply supported end.) 

b Fixed-fixed c F»-ce-free 

d Fixed-hinged e Free-hinged 

12 Find the frequency equation for the transverse vibrations of a uniform cantilever bearing 
a concentrated mass at the free end (Hint At the free end one boundary condition is that 
the shear, instead of being zero, is equal to the inertia force of the attached moss ) 

13 Find the frequency equation for the transverse vibrations of a uniform hinged-hmged beam 
bearing a concentrated mass at its rnid-pomt 

1* Find the frequency equation for a uniform torsional cantilever if a disk of polar moment of 



PARTIAL DIFFERENTIAL EQUATIONS 


CHAP. B 


39S 


inertia /p is attached to the free end of the shaft. (Hint; At the free end of the shaft the 
boundary condition is that the torque, instead of being zero, is equal to the inertia torque 
of the disk ) 

15 Show that the normal modes in Exercise 14 arc not orthogonal 

16 Find the frequency equation for the torsional vibrations of a shaft of length 21 which ih 
clamped at i = 0 and free at j * 2/ if the radius of the portion of the shaft between i =■ 0 
and X * / 18 ri and the radius of the portion of the shaft between x = I and i = 2/ is rj 
[Hint. Solve the problem separately for the interval ((),/) and the interval {1,21) and then, 
m addition to the tw-o end conditions, impose the conditions that at r = / both the angle of 
twist and the transmitted torque are continuous ] 

17 Show that the system (cos nj), n * 0, I, 2, 3, , is orthogonal but not complete over 

the interval {—ir,7r) 

18 Show that for an orthonormal system whether closed or not, we have Bessel’s 

inequality 

^ On* ^ [f(x)Vdx 

n — 1 

where the o's are the coefficients m the generalized Fourier expansion of f{x) in terms of the 
0 ’h and (a,5) is the interval of orthogonality Using this result, show that 

lim f 4>n{x)f{x) dx “> 0 

19 If |0„(a-)l is an orthonormal set over the interval {a,h), show' that the values of the c's 
which make 

fb 

la ~ Ci<tn(x) — C, 4 > 2 (j) - - Cn<t>n(x)]^ dl 

a minimum are the corresponding coefficients m the generalized Fourier expansion of fix) 
in terms of the <^’8 

20 What is the minimum value of the integral in Exercise 19? 


8.6 

Further applications 

Many problems in partial difTerential equations involve featureh 
not found in the simple examples we have used to elaborate the 
standard, elementary theory. We cannot here investigate m 
detail the variations and extensions of this theory, but, as illustia- 
tions, we shall present several additional examples exhibiting 
techniques of practical interest In the first example, we shall see 
how the analysis of the forced vibrations of a continuous system 
leads to a nonhomogeneous rather than a homogeneous partial 
differential equation In the second, we shall see how Fourier 
integrals, rather than Fourier series, enter into problems where 
the boundary conditions fail to provide a characteristic equation 
and X remains a continuous parameter In the third, we shall see 
that, though a partial differential equation may be separable, it 
may be impossible to make its product solutions fit the boundary 
conditions and so other methods must be used to solve it. In the 
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fourth, we shall see how a partial difTerential equation involving 
three rather than two independent variables leads to a double 
senes of eharaetenstir functions and two separate expansion 
problems The nnpoitant matter of the application of Laplace 
transform methods to the solution of partial differential ecpiations 
we shall consider in the next section 


EXAMPLE 1 

^ uniform siniiK of length / la aetrd upon h\ a chatiibuted periochc force 
w 

= — 0(r) Fin u}t 
Q 

If tli(‘ airing is initially at real in its equilibniini position, dotennine ita aiibaequent tnotion given 
thuf Jrictional effecta are negligible 

From Elq (2), Sec 8 2, it la cl(‘ar that the defl(*<‘tion of the string satisfie '3 the partial difler- 
cTitial (‘(jiiatioii 

cl^?/ 

(1) -= — -f- sin (X)t 

dt'^ 


in the case of a systi^ni with a single clegiee ol fi(‘edoin, the motion of the string consista of 
tHo jiarts, one described by the solution of 1 lu* homofiemnus equation 

(■), 

firiLl the othei desrnbed a jiartunlar solution cm re.s])on<iing to the nonhoinogeneoviH term 
r) sin CL’i 

To find the solution of the hoiuogeneous (*q\ialion (2g that is, 1,o determine the free motion 
of tlie string, w'c assume a produi ( solui.ioii 

yH(j,t} =- X(c)T{i) 

and proceed exaitbj as w'e did in solving the wave equation for the toisiona) vi))rationB of a 
fiAcd-hxcd shaft of uniform cross si t tuni in See S4 'Tin r(Mull is 


^3) 


<//d.r,0 


Y mix ( 

/ \ 

M - l ^ 


mrdt 




lin am 



To find a particular solution ol tin' nonhoniogem ous equation (1), we ob.s(*rve that from 
[ihyhical considerations, Ihe motion jirodured l*^ tie' .qq)hed force must b( jieriodie with the 
Shine period as the force ^Moreover, simc the svstcni is a''SUTn('(l tf) be frictionless, it la (lear that 
the motion of the string must be in phase with tin force Ib'nee it is reasonable to assuine i solu¬ 
tion of the form 


T(j,f) = 4>(xj sm u)l 

e tan now proceed in either of two w'a\s In the fust plate, we can substitute 1 (x,() into the 
aonlioinogeiicous equation (1), divide out the eoriimoii factor sin <*)t, solve the resulting non- 
hornogeneoua ordinary difTerential equation namely, 

— “= T (pix) 

tind impose upon it the boundary conditions that 
}^(0,f) = Y(l,t) = 0 
• c , the conditions that 


*( 0 ) - ^{D - 0 
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When ♦(j:) has been determined so that these conditions are fulfilled, we can then construct the 
complete solution 

(4) vix,i) ~ y„(x,t) -h Y(x,i) 


^ nrx ( 

I “"- rV 

n-l ^ 


nirat „ nTat\ . 

An cos - -1- Bn sm -j- J + 4*(i) sm ut 


The initial conditions can now be imposed, givmg 


-I 


mrx 

AnSlJ\~Y 




nira flirX 

— Bn am — -1- 0X^(2-) 


From (5) we conclude that the -A's are the coefficients in the half-range sine expansion of 0, 


hence, An “ 0 for all values of n From (6) we conclude, similarly, that the terms | - /i„| are 

the coefficients m the half-range sine expansion of —cj4*(x), hence, 

2o) f I nirj 

Bn =‘ -/ ^{x) Sin — dx 

nira Jo I 

provided that w is not equal to one of the natural frequencies |a»nl = \nira/l\ of the system, 
1 e , provided that the system la not being "driven” at resonance 

On the other hand, before substituting Y(x,t) = 4»(j) sin ml into the nonhomogeneous equa¬ 
tion (1), we can expand <f>(x) into a half-range sine senes, getting, say, 


" = - f 

“ I Jo 


2 fl nirx 

- «(x) sm ^ d. 


Then, assuming for 4*(2:) a half-range sine expansion with undetermined coefficients, say 

m 

V nrrX 

*ix) “ ) ' T 

n-l 


we have, on substituting 


into Eq (1) and then dividing out am mt, 


[i,0 “(//)« sin J sin ml 

' / 

1 dividing out sm ml, 

-i'>-"7--!'>■(")' 

n-l n-l ' ' 


nrx y' nirx 

sm -A ' l ' 

n — 1 


Making this relation an identity by equating to zero the coefficient of sin nn-xfl for each n, 
we find 

Cn Cn 




y 

«„* — ci>* 


Cn nwx 

-sm- 


/ V - / V (Jn . nirl\ 

♦(x) sin « I 7 -sm- 1 sm mt 

\ Ww* — «* I / 

'n — 1 ' 
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and the complete formal solution of the nonhomogeneous equation becomes 
y(x,0 


( A . r, nTcu\ / V Cn nTx\ 

^^ ^ Bin ^ COB — + fi. sin — j + s,n —j sin 

V' / fiTToi niraf Cn \ 

) sin —— I ^ n cos —— H- Bn sin —— H-— sin ut ) 


To satisfy the initial conditions, we must have 

00 

vix,0) = 0 “ ^ ^nSin^y'*^ 

n = 1 

whence, i4„ ™ 0, and 

/ ^ V nwj (nnn uiCn \ 

= 0 = ) sm - - ( - - /in + -) 

W / \ / — ti>®/ 

n -» 1 ' ' 

whence, 


mra _ cuCn uj'^Cn 

—— Bn H-- 0 or B„ -- 

c ojn^ — O)* nirtt(aj® — ai„*) 


From the expression for B^ it is clear tliat the frequency w of the impressed force must not 
coincide with any natural frequency w„ of the slrinu urih-ss the corrcsiiondmp; coefficient C„ is 
cfiual to zero, that is, unless the term 


nwT X 

sin m sin oin 
I n 


18 missing from the half- age sine expansion of <i>(x) If w = a>„ and C„ ^ 0 for some particular 
value of 71, then the string is efTectively being driven at a condition of resonance, and displace¬ 
ments of arbitrarily large amplitudes will bo built up (See Exercise 1 } 


EXAMPLE 2 

A slender rod whose curved surface is perfectly insulated stretches from x ■=• 0 to x =“ Find 
the temperature in the rod as a function of x and t if the left end of the rod is maintained at the 
constant temperature 0" and if initially the temperature along the rod is given by u(x,0) = f(x) 
Exactly as in Example 1, S>ec 8 5, we hnd that the function 

u = sin Xx 

satisfaes the heat equation 

d^u ^ dn 

f?x2 “ ^ at 

and the boundary condition at the left end of the rod, 

u(0,0 = 0 

Lacking a second boundary condition, however, we have no further restriction on X Therefore, 
instead of having an infinite set of discrete characteristic values X^, with corresponding solutions 

Un{x,t) - Sin 'KnX 

've have a continuous family of solutions 

u\(x,t) - sm Xx 

'vhere the arbitrary constant B is now associated not with n, but with the continuous parameter 
which can assume any real value 

We cannot speak of an infinite senes of parUcular solutions in this cose Instead of adding 
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the product solutions for each value of n we therefore try integrating them over all values of X, 


(7) u(x,t) «■ j sm Xj dX 

By direct substitution it is easily verified tliat this integral is a solution of the heat equation 
Tt iH now necessary to impose the initial condition v(t,()) •=/(j*) on the solution ?/(a,0 
Setting ^ = 0 in Eq (7), it is clear that this requires that 

fU) « 77 (X) sin \t d\ 

But this IS just an instance of the Fourier integral we considered m Sec 6 7 'i'here, in discussing 
what we called P'ouner sine integrals, we saw [Eq (15a), Sec 6 7] that if 

fix) ^ j B{\) sin X^ dX 

then the coefficient function B{\) is given by 

B{\) b: - f fix) sin \t dx 


Introducing the dummy variable s for x in the integral defining 77(X), we can, therefore, write 
Eq (7) in the form 


u{x,t) 


/■• r 

/■* 

/ p-XJ«/.i* 

■ / /(•'^) X« ds 

J— « 1 

T To 


sin Xt dx 


1 

IT 



e fis) sin \m sin Xj ds dX 


winch IS the required solution 


EXAMPLE 3 

Find the stcady-stat*' potential at anv point of an infinitely long transmission line if a signal 
voltage En cos ut is applied at the sending end j =* 0 
Here we have to solve tlie telephone equation 

(8) -- - LC -- + (RC + GL) + KOe 

dx* dl* dt 

subject to the boundary conditions 

(9) c((),0 = Eo cos ui e{x,i) bounded as x —» =o 

If w^e assume a product solution e{xf) = X(x)7’(n and separate variables, we obtain 
X" LCT" -I- (/er + GL)T' f RGT 

Thus the factor T satisfies the equation 

LCT" + (Tec -f GL)r -h {RG - n)T = 0 
and hence T must be of one or the other of the forms 
COB qt B sin qt) 
e^At -f B) 

Ae^i* -\- Be^i* 

Under no circumstances can the last two expressions represent periodic behavior Moreovei, 
the first expression can represent periodic behavior only if p 0, w'hich is impossible, since 
p w —(ItC GL)/2LC 7 ^ 0. Hence, no product solution of Eq. (8) is capable of describing 
what we know the steady-state behavior of the line must be. 
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If we reconsider the problem, in an attempt to find an alternative method of solution, it 
seems reasonable to expect that, under the given conditions, the voltage along the line will vary 
harmoineally with time while exhibiting attenuation and phase shift depcmling on the distance 
from the .sending end Hence we are Ird to try an expression of the form 

(10) e{x,i) = cos {u)t -b hr) 

If a > 0, this obviously satisfies each of the boundary conditions (9), and perhaps the constants 
(/ and b can be determined ao that it will satisfy the dilTerential equation also 

If we substitute the tentative solution (10) into the telephone equation (8), dividr lut 
AV collect terms, without dilhriilty vie obtain 

[a^ - h* -h - RG] cos (coi + hi) d- |2ah + i^{RC f- GL)\ sin (u,/ -H hi) - 0 

This will be an identity if and only if 

(ID ^ RG - LCui^ 

(12) 2ah = -{RC + GL)a, 

Now by adding the square of Eq (12) to the square of Eo (11), we obtain 
(a> + h^y = (RG ~ lA'co'^r^ f {R(^ I 670®^^’ 
or 

do) a* -f h^ = \/{RG - i {RC -f b7d*<^® 

Idnaliy , by solving (11) and (Id) sinniltaneoiish , w'l tiiid 

a* == c^[^{RG - JA'^-^y 1 (/I'r d d- (RG - lEu;*)] 

/,2 „ - ,,y/{R(i - d- (R(' i f/7d'u>» - (RG - rA'u>^)] 

Idom th(' form of these equations it is < leai that a* and /d jire positive' lienee a and h aie ri'nl, 
Mild, VMth then values now deteiinined, Eq (10) Ix'i nines the lequired solution In f' sirnihir 
rnanni'r, of eoiirsi', the steadv'-state tespouse to m signul voliagi' of the form En sm aif can be 
fo’'nd 

By means of these lesultLS it i,s nov\ jiossible to hnd the steady-state voltage (orrespoiulmg 

tn m///pel iodic signal voltage for if c(0 0 = ftO is .i pcrioda turn tion with period 2},, then it can 

Im* expanded m a Eourn’r seiii's, 

(In wt Zift irt 27rt 

/(/)=— d- 1 ‘‘‘ly f «■> (OS -(- -I hi Sin - b sin d" 

^ ^ 2 i> P P P 

Mild the steady-state* solution loi e.idi t>f these terms can be found Tlien, since^ the tt'leplmne 
eipiat ion it- lineai, the sum of tlu* steadv -st at e* ri'sponses I o e'ai h of these term j \\ ill be tdie steaely- 
Mlate I espouse of the line to the entiii' signal fit) Moreover, if the input signal is not pei iodic, 
the steady-state solution can still be* lounel by a similar analysis using tin* Lourier i^’ilegral 
lather than a Fourier senes 

EXAMPLE 4 

A very thm sheet of metal romeides witli the square in the i 2 /-plane whose vertices are the 
points (0,0), (1,0), (1,1), and (0,1) Th(‘ uppei and low er faces of the sheet are perfectly insulated, 
1^0 that heat flow in it is purely two-dimensional Initially, the temperature distribution in the* 
•'’heet is n(x,y,{)) — If there are no soun es of heat in the sheet, find the temperature at 

"•^iiy point at any sulisoijuent time, given that the edg(*a parallel to the x-axis aie peifectly insu- 
'‘Oed and that the edges parallel to the ly-avis are maintumed at tlie constant ti'inperaturc* 0" 
Here w'e have to solve the two-dimeiiKional form of the heat equation [Eq (14), See 8 2), 

d^u dhi , du 

— - = a* 

dx* dt 


(H) 
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subject to the boundary conditions 


(15) 

(16) 


^(0,v,0 

du I 

dy |x,0,< 


and the initial condition 


0 

0 


K(l.y.O 
du I 

dy lx, 1.1 


0 

0 


(17) u(j,2/,0) -/(j,v) 

Because we now have three independent variables, we begin with a product solution of the 

form 


(18) u{x,y,t) - X{x)Y{y)T{t) 


Then substituting this into Eq (14) and attempting to separate variables, we get 


X" T' F" 



Although y and t enter together on the right-hand side of (19), they are both independent 
of X, and so each side of the equation must be a constant, say n. Thus the factor X satisfies 
the equation 

X" - ^X 

If u > 0, say u »= X*, we have 

X ™ A cosh \x B sinh \x 

But from the first of the boundary conditions (15), namely, 

u{0,v,t) ^ X{Q)ny)T{t) = AY{v)T{t) = n 
it follows that A — 0 Likewise, from the second of the conditions (15), namely, 
u{\y,t) ^ X{i)Y{y)T{t) » (i^ sinh \)Y{ij)T{t) - 0 

it follows that “ 0. Hence, when m > 0 , the factor X{x) vanishes identically, and only a 
trivial solution is possible 
If /I ™ 0, we have 

X — Ax H- B 

and again the boundary conditions (15) can be satisfied only if A =5 = 0 
Finally, if /x < 0, say ^ we have 

X -> A COB \x B sin Xx 

From the first of the boundary conditions (15) we conclude that A = 0. The second condition 
requires that {B sin \)Y{y)T{t) “ 0 and, since we cannot permit B to be zero, we must have 

sin X ™ 0 and X mir m = 1, 2, 3, 

Therefore, 

(20) Xn{x) =» sin wiTTi m “ 1, 2, 3, . . 

Continuing with the other equation arising from (19), we now have 


or 

yn 

( 21 ) —- — 01 — 4 - 


Since y and I are also independent, each member of the iMt equation must be a constant, say tj 
T hus, the factor Y satisfies the equation 

F" - flF 
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If n > 0, say 7 — V®, we have 

K = C cosh vy D 8 inh vy 
and Y’ •= vC sinh vy -|- vD cosh vy 

But, from the first of the boundary conditions (16), namely, 

= X{x)Y\{))T(t) = X{x){vD)l\t) = 0 

it follows that /) = 0 . Likewise, from the second of the conditions (16), nanielv, 

^ ^ A"(r))"{ 1 )7’(0 = A7j-)(i'r smh v)'rH) = 0 

it follows that r -= 0 Hence, when 7 > 0 , the factor )"Ci/) vanishes i(lenticiil'> , and only u 
trivial solution is possible 
If 7 «= 0 , we have 

Y = Cy + D 

and this time the boundary conditions (16) lequin tliat (' = 0 hot do not restrict i> Hence, 
™ Z) is a possible solution for the factor 
Finally, if 7 < 0 , say 7 = we ha\< 

cos vy 4 " sin vy 

and }" = —vC Bin vy + vD cos vy 

From the first of the conditions (10) we conchidi* again that ]> - 0 Tlie wecond of the eonditions 
(16) requires that 

A\-)(-ivr sin v)T{t) = 0 
and, since we cannot permit = 0 , we must have 

Rin V = () arid v = nir n — 1. 2, 3, 

Therefore, ) n(y) ^ cos mry a = 1 , 2 , 3, 

or, including the solution >' = constant obtained w'hen 7 = 0 , 

(22) Fn(v) = feh rnry ri = 0 , 1, 2, 3, 

From (21) it is now clear that the factor T .satlsfle^ Mu' Kiualion 
(rn^ 4 - n»)7r* 

7^' =. _ ^-- T 

a* 

and, hence, that 

(23) 7’ = -h 

Therefore, combining (20) and (22) with (23) we can w'rite the product solution (18) explicitly 

(24) u„r,{x,y,t) = E„,n sin mirr cos nvy e 

None of the product solutions (24), by itself, can reduce to the required initial temperature 
distribution (17) Hence, we must form a senes of these and attempt to make this senes satisfy 
the initial temperature condition Hut now, since we have two independent parameters m and n 
in the product solutions, the general solution for 1 / will be a double senes 

00 OQ 

v( 2 ,yd) = Y w..„(x,i /,0 = X S /CTrr cos TiTT?/c 

m,n n " 0 m “ 1 

VVhen i = 0 , this must reduce to jfj",!;) that is, 

fi^,y) “ X ( X cos nwy 

n -=0 m " I 


du 

dy 3 -,l. 


du 

dy *,0,1 


(2.5) 
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Now the inner summation m (25) is a function only of n and x, say and, hence, (25) can 

be written 

fix,y) - ^ G^(x) COB niry 

n-O 

But, for any particular value of x, this is just the Fourier half-range cosine expansion o! f(x,y}, 
thought of now as a function of y for 0 ^ y ^ 1 Hence, by familiar theory, we can write 

( 26 ) Gn(^) ^ ^ Jq ^y 


But, by definition, 

Gn(3-) “ ^ Emn 810 miTl 

m — 1 

and this is just the half-range sine expansion of the now known function Gn(x) for 0 ^ r 5 1 
Hence, 


(27) E„n ” 2 ^ On(a’) sin nnrx dx 

If we wish, we can substitute for Gnix) from (20) into (27), getting 

f(x,y) cos mry t/7/~j sin ynirx dx 
-•n f{x,y) cos niry am rmrx dy dx 

With Emn determined for all values of m and n, the formal solution is now complete 


EXERCISES 


1 


2 


3 


Can the procedure illustrated in FiXample 1 be rnodihed to obtain a description of the motion 
of the string when the frequency of the impressed force is one of the natural frequencies of 
the string? How? 

Can the procedure illustrated in Example 1 be modified to obtain a description of the 
motion of the string when the impressed force is of the form fix,l) == y>{x)d{t), where (a) 
d(t) IS periodic? How? (b) 0(1) is not periodic? How? 

Work Example 1 with 





0 < X < - 

4 

I SI 

< X < — 

4 4 

SI 

— < X < / 

4 


4 Work Example 1 with <f>{x) = x(f — x) 

6 A uniform string of length I is acted upon by a distributed frictional force equal at each 
cw dy 

point to — " where r is an arbitrary proportionality constant Discuss the subsequent 

g dt 

motion of the string given that it begins with initial displacement i/(x,0) = g{x) and initial 
velocity v(x,0) ™ h{i) In particular, show that certain frequencies m the “spectrum” of 
the string may be overdamped, and determine which ones Do the concepts of magnification 
ratio and pheise shift apply to the vibration of a string with viscous damping? How? 

6 A uniform string for which a ■» 1 and f * ir begins to move with initial displacement 
y(x,0) “ j^(x) and iniiial velocity i/(x,0) — h{x) Determine the subsequent motion of the 
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string if It IS acted upon by a distributed frictional force equal at each point to - — —» 

g dt 

where ar = l bc = 2 c<-4 dc-8 


7 


8 

9 


10 


11 

12 


13 


A uniform shaft of length I with both end.s free, vibrating torsionaJIy, 18 acted upon by a 
periodic impressed torque equal at each point to (< 7 /pJ) 0 (x) sin U If the initial displace¬ 
ment of the shaft is 6(x,()) == ( 7 (x) and if its initial angular velocity is (?(t,0) -=» h(x), discuss 
the problem of determining its subsequent motion 

Work Kxercise 7 for a uniform shaft of length / fixed at x = 0 and free at x « / 

Find the steady-state motion produced in a uniform beam of length / which simply 
supported at each end given that the beam is acted ujmn by a distributed load whose 
magnitude per unit length is t{I — x) .sm ul 

A uniform cantilever beam is built in at x = 0 and free at x = / Find +lie steady-stale 
motion produced m the beam by a distributed load v\ho8e magnitude per unit length is 
X Bin Oil 

Work Example 2, given that the left end ot the rod is perfectly inKulated 
A slender rod of infinite length has its curved .suihice perlectlv insulated Find the steady- 
state temperature distiibution in the lod if the teinpeiatuTe hI the finite end of the rod 
varies according to the law u{{),l) = sm oil Explain hovi this lesult can be used to determine 
the steady-state temperature distribution piodueed by an arbitrary periodic temperature 
eondition at the finite end of the rod 

A Blender rod of length / has its curved surface perfectiv insulated Its right end is main¬ 
tained at the constant temiieratuie u(l,l) = 0 th(‘ left end the temperature varies 
according to the law' u(()J) = sin oil Deterniinr the s.eadv state temperature distiibution 
m the lod l^xp n how this result can be used to determine the steady-state teniperatuie 
distribution produced in the rod by an arbitrary periodic temperature condition at the 
left end (Hint Verify that X can be chosen .so that 


7<ifx,0 = sin Oil cofl -cosh X 


b-0 


cos Oil sin sinh X 


(-0 


and 


U 2 (x,t) = Hill Olf ( OS X 




Xx 


cosh — — cos Oil sm X 


(-0 


sirih 


o-rc solution.s of the nne-dimen.sional heat equation Then determine A\ and Ai so that 
u(x,f) = Ai 74 i(x,t) + AzUilxJ) .satisfies the boundary conditions of the problem ] 

14 A slender rod of lengtli / has its (ur\ed surface uid left end perfectly insulated Heat is 
generated within the rod at a rat<* per unit volume equal to 0(x) i md tVie temperaturi' in 
the rod as a function of x and (, if the right end of the rod is maintained at the constant 
temperature ?/(/,n = 0 and if the initial temperature distribution in the rod is u(.\0) » g(x) 
16 If the transmiBsion line in Plxample 3 is initially “dead,” i e , if at t “0 the potential and 
current along the line aie identically zero, determine the complete response of the line, 
transient aa well as steady-.state, to the signal voltage Kq cos oil (Hint Show that, if 
~p ± iq are the roots of the equation 


LCm^ + {RC + (iDm A- {RG -b X>) « 0 
then u\ “ c"'*' l^‘l(X) cos ql A- B{\) sin ql] am Xx 

18 a solution of the telephone equation which is bounded as x and is zeio for all values 

of I when x - 0 Then show' that the Hteady-slate solution found in Example 8 plus the 
integral of ux over all values of X is a solution which eatisfies both boundary conditions (9) 

Oe 

Finally, determine A (X) and 7i(X) so that both e and — are zero when t - 0 ) 
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16 Work Example 3, by replacing the signal voltage Eq cos ut by Eo and assuming a 
solution of the form u{x,t) *= Eo 

17 Work Example 4, given that the edges from (0,0) to (0,1) and (1,0) are maintained at the 
constant temperature 0° and the other two edges are insulated 

18 Determine E^n m Exercise 4 for f{x,y) = x -\- y 

19 A thin sheet of metal coincides with the square in the ly-plane whose vertices are the points 
(0,0), (1,0), (1,1), and (0,1) Along the edge from (0,0) to (1,0) the temperature distribution 
u{x,0) = fix) 18 maintained The other three edges are maintained at the temperature O'" 
Find the steady-state temperature as a function of j and y 

20 Work Exercise 10 if the boundary conditions are 


a u(x,0) » fix) 

du 1 

du 

1 1 

- 1 

— — 

“ - 1 “ 

dy k,i 

dx 

|0,l/ (lx 11,1/ 


du 1 



b u(x,0) ™ w(x,l) = 0° 

Ox jo.y 

= 0 

= fiv) 


21 If an aibitrary temperature distribution exists along each of the edges of a square sheet of 
metal, how can the steady-state temperature distribution in the sheet be found? 

22 A thin sheet of metal bounded by the x-nxis, the lines j- = 0 and x = 1, and stretching to 
infinity in the ^/-direction has its upper and lower faces insulated and its vertical edges 
maintained at the constant temperature 0° Over its base the temperature distribution 
u(i,0) = 100” IS maintained Find the steady-state temperature at any point iii the sheet 

23 Work Exercise '22 if the boundary conditions are 

fiu I i)u I 

H _ 1 aE — =0 = 100° 

Oj 10,1/ ()x U.i/ 

b u((),y) “ 0° n(l,V) = 100° //fj-d)) = lOOx 

•In 1 

c uH),y) “=0° — =0 u(x,0j = 100° 

dx 1 1 . 1 / 

24 Work Exercise 22, given that the left edge and the lower edge of the sheet are maintained 
at the temperature 0° and the known distribution u(l,7y) ■>= /(//) is maintained along the 
right edge 

20 Determine the natural frequencies and nodal lines of a uniform square drumhead 


8.7 

Laplace transform methods 

In (’hap 7 we observed bow (he Laplace transformation con¬ 
verted an ordinary, linear, constant-cocfficicnt differential equa¬ 
tion into a linear algebraic equation from which the transform of 
the dependent variable could readily be found. In much the same 
way, the Laplace transformation can often be used to advantage 
m solving linear, constant-coefficient partial differential equations 
in two independent variables. In such cases it leads not to an 
algebraic equation but to an ordinary differential equation in the 
transform of the dependent variable The general procedure is as 
follows 

The given partial differential equation, with its accompanying 
boundary conditions and initial conditions, is transformed with 
respect to one of its independent variables, usually I Partial 
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derivatives with respect to this variable are, of course, transformed 
by the familiar formulas of Theorem 2 of Sec. 7 2 and its corollary. 
For partial derivatives with respect to the other independent 
variable we assume* that the operations of differentiating and 
taking the Laplace transform can be interchanged Then, if the 
independent variables are x and i, say, we have 


df{x,t) 

dx 




'di = 


the denvative in the last term being a total derivative b( *ause 
not a function of t. Similar formulas, of (‘oiirse, hold 
for x-derivatives of higher orders Thus, the icsait of the trans¬ 
formation IS an ordinary differential equation in H/(j,OI m 
whicli X IS the independent variable and s enters as a parameter. 
Because s occurs in the coefficionls of the differential eiiuation, the 
arbitrary constants appearing in its complete solution will in gen¬ 
eral be functions of s which miust be determined by imposing the 
transformed boundary conditions on tlic complete solution of 
the transformed differential eiiuation After this has been done, 
the inverse transformation is carried out and the solution to the 
original problem is obtained The details of this process can best 
be made clear through examples 


example 1 


A semi-infinite string is initially at rest in a position ooinnding with the positive half of the 
T-axig At t = 0, the left end of the string begins to move along the j/-axi8 in a manner described 
f’y = f(t), where f{t) is a known function Find the displaceinent y(x,t) of the stung at any 

point at any subsequent time 

The partial differential equation to be solved is, of course, the oiie-dimensional wave 
equation 


( 1 ) 


d^y , d^y 
— = a* — 
dt* dx* 


subject to the boundary conditions 

(3) y(x,t) bounded as x —► « 

and the initial conditions 


(4) 

(ri) 


y(x,0) » 0 

I 

-- =0 
dt li.o 

If we take the Laplace transform of Kq (1) with respect to t, we obtain 


a*£ly(x,01 - ~ 

p using the initial conditions (4) and (5), 


dt i.o 


a»£ 


d*y{x,t) 

dx* 


d* 

3 a - 

dx* 




( 6 ) 


dx* a* 


This is justified by Theorems 3 and 6, Sec 7.1. 
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Solving this ordinary difTerential equation for £>[y{x,l) j, we find without difficulty that 
(7) £{y(x,0l - 

To determine the coefficient functions ^4(8) and B(a), we observe first that, if y{x,t) remains 
finite as I-+ 00 [condition (3)], so must £|y(x,0) Hence, Bis) must be zero Furthermore, 
putting I “ 0 in (7) after Bis) is set equal to zero, we have £|^/(0,0) * and, from the 
boundary condition (2), we have £{i/(0,OI = £|/('0I Therefore, (7) becomes 

£|V(X.0)’ -£(/(0le-f''»>* 

The inverse of this can be found at once by suppressing the exponential factor and using 
Corollary 2 of Theorem 6, Sec 7 4 The solution to our problem is, therefore, 

which represents a wave traveling to the right along the string with velocity o Evidently, the 
effect of this wave is to give the string at a general point the same displacement that the left 
end of the strmg had x/a units of time earlier 


EXAMPLE 2 

A semi-infinite string is initially at rest in a position coinciding with the positive half of the j-axis 
A concentrated transverse force of magnitude moves along the string with constant velocity v, 
beginning at < — 0 at the point a- * 0 Find the displacement of the string at any point 

at any subsequent time 

In this problem, since there is an external force applied to the string, we must use the non- 
homogeneous wave equation (Eq. (2), See 8 2] 





+ - nx,t) 

w 


To obtain Fix,t) we observe that a single concentrated load Fo acting at the point x =» vl corre¬ 
sponds to a load per unit length which is infinite at t =* ei and zero everywhere else Hence, 
since h\ is assumed to act on the string m the negative j/-direction, 





where hit — x/v) is the unit impulse, or 6 function, which we discussed in Sec 7 7 (lur problem, 
therefore, is to solve the equation 



subject to the boundary conditions 

(9) j/(0,0 - 0 

(10) yix,t) bounded as x —> « 


and the initial conditions 


( 11 ) 

( 12 ) 


l/(x,0) - 0 

^1 -0 
at U.o 


If we take the Laplace transform of Eq. (8) with respect to t and use the initial conditions 

(11) and (12), we obtain, just as in Example 1, 

d* _. . .. g 
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d* . 8 * gFo 

(VS) - £\u{x,t)\ - ~£\y(x,t)\ - ^ c" 

ax* a* ahv 

The solution of this equation by the niethods of (/hap 2 presents no diiriculty, and wo find, for 
the complete solution, 


■C(y(-r,0} = + 


ie(o* - i;*)8* 
gFi 


g -V a 


In each case we must have/?( 8 ) = 0 m order that A! ) Bho’dd remain finite as t «, 

To determine >4(s) we have, from the boundary condition (9), tlie inf ormation tljat, wiien x ^ 0, 

£{y(x,n\ ^£{yH),t)\ - 0 

llente, substituting into Kq (14), w'e obtain 


iu(a* ~ 


and, therefore. 


£\>Ax,t\ 


te(«* - r 


- jg (I'vO g ^ r(a).| „ ^ „ 


Taking mvers ., w^e have finally 




Plots of (15) m the “subsonic" case v = ^ 40 , and the “suporsonie" case v = f‘ 4 a, and of the 
‘transonic" case c = a described bv (10) are shown in Fig 8 14 for a tvpical time t The dis- 


FIGURE 8 14 
Plot showing 
the displaee- 
ment of a semi- 
infinite stung 
produced by a 
concentrated 
force moving 
along the string 
with a velocity 
(a) (h) 1 , 

and (c) 
times the 
propagation 
velocity for the 
string 
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continuity in yix,t) in the “transonic” case when the disturbance travels with exactly the 
propagation velocity a is interesting. 


EXAMPLE 3 

A semi-infinite cable of negligible leakage and inductance is initially “dead ” At f 0 an arbi¬ 
trary signal voltage E(l) is suddenly applied at the sending end Find the potential e(r,t) at any 
point on the cable at any subsequent time. 

In this problem we have to solve the telegraph equation (21a), Sec 8 2, 


(17) 


—- — a* — 

dT* at 


a* - RC 


subject to the boundary conditions 


(18) e(0,0 - E(i) 

(19) ^(a'.Z) bounded as j—» « 
and the initial condition 

(20) s(i.O) - 0 

Taking the Laplace transform of (17) NMth respect to t and using the initial condition (20), 
we obtain 

- a*«£{c<x,01 

as the ordinary ditTerential equation satisfied by the transform of the potential Solving this for 
£|e(;r,f)} we find without difficulty that 

(21) J2(e(i,<)l - 

Since e(x,i) and, hence, JE|<f(a-,f)l are to remain finite as j it is necessary that “ 0 

To determine A(«) we observe that, when i * 0, 

£{e(x,t)\ - JC|£;(0l 

Hence, substituting mto Eq. (21), we find 
A{8) - LMis:(z)i 

and 


(22) £|«(i,0| - £|E(()le-“Vi 


To determine e(x,t) it will be necessary to use the convolution theorem, but, before this 
can be done, we must know the inverse of Up to this |K)int m our work \^e have not 

encountered any function of t having this function of h for its transform However, it can be 
shown (see Exercises 1 and 2) that 


£ 


2\/wt'^ 




Hence, taking b ax and setting up the convolution integral, we obtain from (22) 

nr ri o***/4X 

(23) e(x,<) - — /' Eil - X) - -— dX 

2\/irJo x\/x 

In particular, if E{t) is a unit step voltage, we have, since — x) » I for X < /, and 


t This 18 identical with the one-dimensional heat equation, and so all our 
conclusions apply equally well to the problem of the flow of heat in a slender, 
insulated, semi-infinite rod w hose left end is maintained at the time-dopondent 
temperature Uo(Z). 





SEC i.r 


LAPLACE TRANSFORM METHODS 


343 


— X) — 0 for X > f, 


e(x,t) - 


rt 


2 \/ir •'® X \A 

If we let <2 *x*/ 4X — «*, then X — d\ — —a*x'/2z* dx, and the last integral l>ecomefl 

ax fax/2y/t ^ 8z> 

2 V, /- ' ' «•: 

2 


^ 

fi«x» y 2z* J 


(24) 


e(x,0 - 7^7^ 

Jaz/2y/t 

2 /-• 2 /•ax/2V^ 

— I e • dz -Tz / «“* dz 


dz 


Under the substitution z* *• e, the first integral becomes 


V' \V 


since I’Oj) *» y /t Henc<*, Eq (24) can be* written 

f aj/2v < 


t{x,l) - 1 


V/: 


2 r» 


c '* dz 


(25) 

where 

(2G) 


- I - erf -- 


2y/t 


erf (tf) 


2 r<» 




r-- 


* dz 


Thm ih the so-called error function, a tnbulated function which can be found in most handbooks 
of mathematical tables • 


EXERCISES 

-'c‘^ ' 

Vz 

show by means of the substitution u — X/z that 


1 If /(X) - , dz 


AX) 


/•- 


dw 


Hence, b^ difTercntiating the first expression for f{\), show that 

/(X) 


r(x) - - 


V ^ 


* Actually, most handbooks list not the error function as here defined anc 
used m physics and enginocnng, but rather the so-called probabibty Integra 
of mathematical statistics, 

^(0) - 

V 2ir J 0 

If the substitution z = w/ \/2 is made in the error function (20), it becomci: 



and wc obtain the relation 
erf E » 24*(\/2 9) 
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Solve this differential equation, using the fact that 

/(O) - r(H) - v/i 

and show that 

/(X) - 

Finally, use this result to show that 

2 Use the results of the last exercise, together with Theorem 8, Sec. 7.4, to show that 




g-bVi 


fl a In Example 3, what is the response of the line if £(1) is a unit impulse voltage? (Hint. 
Recall from Sec. 7 7 the relation between the response of a system to a unit step function 
and to a unit impulse ) 

b Using Eq (25) and the appropriate Duhamel formula, obtain a formula different from 
Eq (23) for the response of the line in Example 3 to a general voltage 

4 Using Laplace transform methods, determine the motion of a string of length I whose 
initial displacement and initial velocity are, respectively, y{x,()) “ sm mvx/l and y(x,0) - 
sin nrx/l Can these results be used to obtain the motion of the string jiroduced by arbi¬ 
trary initial conditions? How^ 

6 Using Laplace transform methods, determine the response of a string of length I to a dis¬ 
tributed force /(x,t) “ (sin nwxH) sin titl if the string is initially at rest in its equilibrium 
position. Explam how these results can be used to determine the resiKinse of the string 
to a distributed force /(-r,0 — g{x) sin oil, where g{x) is defined arbitrarily on the interval 
0 < z < I, and to a distributed force (sin nwx/l) hit), w'here h{t) is an arbitrary periodic 
function whose frequency is distinct from each natural frequency of the string 

6 Work Example 2, given that the transverse force which moves along the string is a rec¬ 
tangular pulse of height Fo initially acting on the portion of the string between j “ 0 and 

X - 1. 

7 A serai-mfinite string whose weight per unit length is u; has its left end fixed at the origin 
The infinite end is fastened to a rmg whifh slides without friction along a vertical rod 
Initially, the string is at rest in a position coinciding with the positive /-axis At f — 0 the 
support w'hich maintained the string in its horizontal position is removed and the string 
begins to fall freely under the influence of gravity. Determine its subsequent position os a 
function of x and t 

8 A shaft of uniform cross section is built in at x — 0 and free at x *■ / At < 0, while the 

shaft is at rest in its equilibrium position, a constant torque To is suddenly applied to the 

free end Find the Laplace transform of the resultant angular displacement What is the 
angular displacement of the free end as a function of time? (Hint The boundary condition 

30 

at X — f IS ErJ — — To. 

dx 

9 Work Exercise 8, given that the torque applied at the free end is a unit impulse instead of a 
step function 

10 A semi-infinite string initially at rest in a posh ion coinciding with the jiositive x-axis w 
acted upon by a concentrated force Fo sin (at applied at the point x — 6 Find the Laplace 
transform of the resultant displacement of the string What is the displacement of the 
string at the point x 6 as a function of time? 
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Theoretical preliminarief 

In Holving partial difTercntiiil eijuations by the method of separa¬ 
tion of variables, wc are often led to ordinary differential equa¬ 
tions with variable coefficients which cannot be solved in terms of 
frmiliar functions. The usual procedure in such cases is to obtain 
solutions in the form of infinite series, which can be taken as the 
definitions of new funetions to bo studied in detail and eventually 
tabulated if they prove of sufficient inifiortance. In this section we 
shall discuss the general problem of obtaining series solutions of 
the form 

fl) y - (x - a)''[ao + OiU — a) -f - 0 )=^ -h • J 

for the general linear second-order differential equation 
^2) y" -+■ P{i}y' + Q(i)y = 0 

We shall not re(|uire the exponent f to be a positive integer, and in 
general it nmH not be. Hence the solutions we obtain will usually 
not 1)0 Taylor expansions. 

The analvwsis involves a consideration of several cAses, 
depending upon the behavior of the coefficient functions P(x) 
and Q(x) at the tioint x = a around which we propose to expand 
the solution y In most of our work, the variables x and y and 
tke coefficient functions P{x) and Q{x) will all be real. However, 
this is not a necessary restriction, and, in the basic definitions 
and theorems we shall introduce in this section, x, y, P(x), and 
0(x) may be either real or complex. In the first place, both P(x) 
and Q{x) may be analytic at x “= a; that is, they may possess 
Taylor expansions around the point x = a. W’hen this happens, 
X = a is said to be an ordinary point of the differential equation. 
A point which is not an ordinary point is called a Bin|;ular pQint 
At a singular point, althoi^h P{x) and Q(x) do noTboth possess 



a4« 


BESSfL FUNCTIONS AND LIOENDRE POLYNOMIALS 


CHAP. 9 


Taylor expansions, it may be that the products 
(j — o)P(x) and (x — a)^Q(x) 

do have Taylor expansions. A singular point at which this is the 
case 18 said to be regular; otherwise it is called irregular. In our 
work we shall bo concerned exclusively with the expansion of solu¬ 
tions of Eq ( 2 ) around ordinary points and regular singular points 


EXAMPLE 1 

For the differential equation 

2 , 

y" +-!/' + 


t(x 


-1/ - 0 

1 )*^ 


X *» 0 and jc “ 1 are singular points, since at j- * 0 both P(j) and (?U) become infinite, while 
at I 1, altholugh P(j) is analj^tic, Qtj-) becoinea infinite AM other [joints arc ordinary points 
The point x >* 0 is a regular singular point, since each of the products 


xP(x) 


and 


x*Q(j) - x» 


3 


3x 


x(j - 1)» (j - !)• 


IS anal>'tic at x = 0, i e , can bo expander! in a senes of positive integral [lowers of x The [>oint 
X 1 IS an irregular singular point, however, t^ecause, although the product 


(x -- DA^x) “ (x — 1) 
is anaJ^^ic at x =» 1, the product 

(x - n*<?(x) = (x - D* 
becomes infinite there and hence is not analytic 


0 )--;” 


_3 _ _ 

xTx - Ip “ x(x - 1) 


The importance of IhcclaKsificalion of values of Jinlo ordiiuirv 
and singular points is appan*nt fnini the following theorems, which 
are proved in more advanced treatrnenU of the theory of differen¬ 
tial equations.* 


THEOREM 1 

1 At an ordinary point z = a of the differential equation j/" -h P(x)f/' + Q(x)f/ = 0, 
! every solution is analytic; i.e , can tie represented by a scries of the form 

?y = Qo “1- ai(j — a) -h 02(1 — a)* -\- 

Moreover, the radius of convergence of each senes solution is otiuiil to the distance 
from a to the nearest singular point of the equation. 

THEOREM 2 

At a regular singular point x = a of the differential etjuation 
y^' 4- P(x)y' -h Q(x)y = 0 


* See, for instance, E. T Whittaker and G. N. >Vat8on, “Modem Analysis,’’ 
pp. 1947203, The Macmillan Company, New York, 1943. 
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there is at least one solution which possesses an expansion of the form 

2 / *= (x - a)'[ao -h ai(x - o) - a)* -h ■ ■ ] 

and this series will converge for 0 < |x — a| < /?, where R is the distance from a 
to the nearest of the other singular points of the equation 

THEOREM 3 

At an irregular singular point x = a of the differential equation 
y'' + P{x)y^ -f Q{x)y - 0 

there are in general no solutions with expansions consisting solely of powers of 
X — a. 

In using Theorems 1 and 2 to infer the radius of convergence 
of power senes solutions of Eq. (2), it must be borne in mind that 
the singular point nearest to, but distinct from, the point of expan¬ 
sion may f»e complex, even though the point around which we are 
expanding is real. For instance, for the differential equation 

y" + r^.y' + v = o 

the coefficient functions 

P(x) = and Q{x) = 1 

1 -h X* 

are analytic for all real values of x However, P(x) fails to be 
analytic at x = ± t; hence, fhese two points are singular points of 
the differential equation. Therefore, a series solution around the 
ordinary pciint j — 2, say, would have radius of convergence 
R ~ \/7), since in the complex plane the distance from the point 
of expansion X — 2 to the nearest singular point x = i(orx = —i) 
IS \/5 (Fig. 9.1). 



To obtain series solutions of Eq. (2) around an ordinary 
point or a reqular singular point we use the so-called method of 
Probenius.* First of all, for convenience, we translate axes, if 


Named for the German mathematician P. G. Frobenius (1849-1917). 
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necessary, so that the point of expansion becomes the point x = 0. 
Now, if X = 0 is either an ordinary point or a regular singular 
point, both xP{x) and x^Q(x) are analytic, and, hence, we can 
wnte 

xP(x) = 6 o + bix + 62 X* + ‘ ■ 

x^Q(x) = Co + cix + cjx® -f 

Therefore, multiplying Eq ( 2 ) by and then substituting for 
xP(x) and x^Q(x), we have 

(3) xY' + ^{bo -h biX -b b 2 X^ + “ ■ •)y' 

-h (co -h CiX + CaX* -f ■ )y = 0 
Next, we assume a series of the desired form 

(4) y = x^(ao 4- a^x -h + * •) 

where, without loss of generality, we can suppose that ao 0 If 
we substitute this senes into Eq (3), we have 

x^[aor(r — l)x’-'2 + ai(r + l)rx’"^ + a2(r 4* 2)(r + l)x’' -f * •] 

-h x(5o 4- biX 4- biX^ 4- • ■ )[aorx’’-i 4* ai(r 4* 1)^’’ 

4“ O'zi'f “h 2)x’”*'^ + ] + (co + Cix 4^ CzX® + ) 

X -f 4 - ) = 0 

or, collecting terms on the various powers of x, 

(5) ao[r{r - 1) 4" hor 4- Co]x’‘ 4- joiKr 4* l)r + boir 4" 1) 4- Co] 

4- ao(6ir -h + [a^Kr 4- 2)(r + 1) + bo{r -f 2) 4- Co] 

-h ai[bi(r -|- 1 ) + Ci] + ao( 62 r 4- C 2 ) }x ’’+2 + = 0 

Equation (5) will be an identity if and only if the coefficient of 
each power of x is zero, and thus we obtain the set of equations 

ao[r(r — 1) + bor + co] = 0 

( 6 ) ai[(r -I- l)r 4- bo(r -f 1) + Co] 4- ao( 6 ir 4- Ci) == 0 

< 12 [{t "h 2)(r 4" 1) 4- hair -f 2) 4- Co] + ai[6i(r -}- 1) + ci] -f -h C2) = 0 

Since flo ^ 0, d follows from the first of these equations that 

(7) -f (60 - l)r + Co = 0 

This quadratic equation in r is known as the indicial equation 
of the differential equation relative to the point of expansion, 
and its roots ri and rj are known as the exponents of the differ¬ 
ential equation at that point For each of these values there is, in 
general, a series solution of the form (4) And the coefficients in 
these expansions can be determined, one by one, from the suc¬ 
cessive equations in the set ( 6 ), which express each of the o's, 
in turn, in terms of the o's preceding it in the series (4) 
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EXAMPLE 2 

Find senes solutions for the equation + (x -h 2)y “ 0 around the origin 

Since P{x) “ 0 and Q{x) — (x -}- 2)/9x*, it follows that the origin is a regular singular 
point of the given equation Hence, by Theorem 2, there exists at least one solution with an 
expansion of the form 

y - x'(ao -f a,x + Oax* + ■ ) 

Substituting this into the differential equation, we have 

9 x"[ao7-(r — l)x'’“® 4- ai(r -|- l)rx»-’ -}- -f afc+,(r -j- k l)(r -|- jfc)x’"^*"‘ -t ) 

+ xi flox^ + 4- 4- ) 

4- 2( oox- 4- 4- • 4- «A^,x^+*+' 4- ) - 0 

or, collecting terms, 

ao[9r(r -1)4- 2]x'' 4- (ai[9(r 4- 1 )r 4- 2] 4- Oo) ‘ 4- 

4- la*+,[9(r 4-^4- l)(r 4 fc) 4" 2] + a*)x'-''*+i 4- “ - 0 

For this to be an identity we must have 

9r(r ~ 1) 4- 2 = 0 
ai[9(r 4- l)r 4- 2] 4- a.. - 0 

a*^i[9(r 4- k -f l)(r -f- A:) 4- 2l 4 a;k = 0 


The first of these is the indicial equation whose roots are r =» From the second we find 

that 

__ ap _ 

“ (3r +'l)(3r + 2) 

and, from the general recurrence relation, we have 


a*+i 


_ ttfc_ _ 

13(r + k) + l][3(r + k) + 2] 


(■onsidenng these first for r = and then for r = we obtain the coefficient sequences 


1 

Op ™ Op, 

ao 



do 

r _ 

j B - ^ - 1 

2 3 

Oi * — 

.') 6 ” 

2 3 5 6’ 



a, = 

Oi 


do 



”89“ 

~ 2 T 

5 6 8 9’ 

2 

Oo ™ 0 , 0 , 

Oo 


Ol ^ 

Oo 

“ 3 

a. 

6 7“ 

3 ”4 6 T 



a, = - 

ai 


do 



9 10 “ ' 

3 4 • 

0 7 910 ’ 


With these coefficients, taking an “ 1 for convenience, we can construct the two particular 
solutions 


Vt 


Vi 


3-1^ (^1 _ _JL +- - - 

V 2 3^ 2 3 5 6 

A _ +-— 

V 3 4 3 4 6 7 


2 3 5 6 8 9 "*" 

X* 

3 4 6 7 9 10 "*" 


) 

) 


•Since all values of x except x — 0 are ordinary points of the given differential equation, it follows 
from Theorem 2 that these series converge for all values of x Finally, since y\ and |/i are clearly 
indepiendent, i e , have nonvanishing Wronskian, it follows from Theorem 2, Sec. 2 1, that the 
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complete solution of the given equation is an arbitrary linear combination of these two particular 
solutioiis 

If the indicial equation has a double root, it is obvious that 
two series solutions cannot be obtained by the present method 
It is also true (though not obvious) that, if the roots of the indicial 
equation differ by an integer, this method fails, m general, to 
provide a second series solution.* In either of these cases, how¬ 
ever, a second solution can be found by the method of Sec 2 1, 
that IS, by assuming y = 0(x)i/i(x), where yi{x) is the first series 
solution, and then determining 4>{x) so that the product will 
satisfy the given differential equation 

EXERCISES 

1 Fmd the singular points of each of the following equations, and determine whether they 
are regular or irregular. 

a + v' -I-1/ “ 0 ^ -I- y' + 1/ “ 0 

c ar*(l - x)y" + (1 - x)y' -}- ?/ - 0 d (1 - i*)y" -h y' + y - 0 

2 Find the indicial equation relative to each of the singular points of each of the equations 
in Exercise 1 

Find series solutions around the origin for each of the following equations 

3 {4x -h l)y “ 0 4 xV' -h (x - 2 ) 2 / - 0 

» -H 3x2/' + - l)y “ 0 6 2x^y" + (2x» -h 3x)y' + (x - 1)?/ 0 

7 The '‘point at infinity" ks said to be an ordinary point or a singular point of the differential 
equation 

^ + r(T) ^ + QWv - 0 
dx* ax 

according as the equation obtained from this by the substitution x = \fu has an ordinary 
point or a singular point at u = 0 Show that, under this transformation, the original 
equation becomes 



and use this result to determine the nature of the point at infinity for the equation 

(X* -b l)t/" y' y = {) 

6 Show that, if the origin is an irregular singular point of the differential equation (2), then 
the indicial equation relative to the origin is at most of the first degree 
9 Verify that, if the roots of the indicml (equation differ by unity, then, in general, the two 
roots lead to the same series solution of Eq (2). When will this not be the case? Is this true 
if the roots differ by an integer greater than 1 ? 

10 Verify that under the change of dependent variable defined by the substitution 

y - 

the differential equation (2) becomes 

~ -b R{x)z - 0 
dx* 

where R(x) - Q(x) - \ - \p^{x) 

2 dx 4 


See Exercise 9. 
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9.2 


The series solution of Bessel's equation 


( 1 ) 


( 2 ) 


(3) 


Probably the most important of all variable-coefficient differential 
equations is 




dx^ dx 


-h 




v^)y = 0 




.^hich is known as Bessel’s equation of order i' with paramet^C^.t 

This arises in a great variety dP^oblems, including almost all 
applications involving partial differential ecpiations, such as the 
wave equation or the heat equation, in regions having circular 
symmetry 

As a preliminary step in the .solution of Kq (1), let us change 
the independent variable from x to t by means of the substitution 


t = 'Sx 


Since 


dx dt 


and 


I'JV ^ X2 

C/J2 df 


Eq (1) then becomes 

,, g + , I ^ ),.0 

V hich IS known .simply as Bessel’s equation of order v. 
For Eq (8) it is clear that 

1 P 

Pit) = j and Qit) = -- 


Hence, the origin is a regular singular point of the equation, iij^ 
all other value.s of i are ordinary points At the origin, where we 
propose to obtain series solutions of (8), the indicial equation 
[Eq. (7), See 9 1] is = 0, and, therefore, by the theory 

of tlie preceding section, we are led to try a .senes solution of the 
form 

(4) y = r(ao + ad + a^P -h ) '' 

Substituting this series into Eq (3) and displaying the terms 
in a convenient array, we have 


[ao*'( 

> - 

+ ai(i' + 1) W*''' ' 

+ o,(v -1- 2)(w + + 

4 akiv + *)(^ 4 A: - 1)1''^* 4 

1 

+ I 

aort' 

+ a,(.- + 

+ o»(i' + 2)1"+* + 

4 □*(•' 4 4 

1 

-f ( 



aid’'** 4 

4 4 

) 

+ ( 

- rlarf' 


- - 

- 4 

) - 0 


This will be an identity if and only if thQ,„coefficicnt of every 
power of t is zero The coefficient of P is automatically zero, since 
V IS a root of the mdicial equation From the coefficient'of 


t Named for the German mathematician and astronomer Friedrich Wilhelm 
Bessel (1784-1846), although i^ecial cases of this equation had been studied 
earlier by Jakob Bernoulli (1703), Daniel Bernoulli (1732), and Leonhard 
Euler (1764) 
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we obtain the condition 

ai(2p + 1) = 0 

and, in general, for fc ^ 2, we obtain from the coefficient of 
OtK*' + + A; — 1) -1- + fc) — »»*] + ak-2 ^ akk(2v k) dk-i = 0 

or 

__ dk-2 

“* " ki2v + k) 

Now it is clear that ai must be zero for all values of v except 
possibly V = — ^ven in this case we can assume Oi = 0, 

since we are interested only in conditions sufficient for the exist¬ 
ence of solutions of the form 


Moreover, from (5) it is apparent that any coefficient a* is a 
multiple of the second preceding coefficient a *_2 Hence, beginning 
with ai, it follows that every coefficient with an odd subscript, 
must vanish 

On the other hand, starting with ao, which is still perfe(;tly 


arbitrary, and taking 

k = 2, 4. (i, 

successively in the recur- 

rence formula (5), we 

have 


do ~ do 



do 

do 


2 (^i-T 2 ) 2*“ 

1 !(^ + 1) 



d2 

do 

a - - 

‘ 4(2k + 4) 2* ■ 

2{p -j- 2) 

2 <2'(*' + 2)(.. + 1) 

at 

d4 _ 

do 

“• “ 0(2i. + 6) 2'' 

3(r + 3) 

2'3'(»' + 3)(.. + 2)(p + 1) 


and, in general, a 2 m 


_ (-l)"ao _ 

22m^l(^ -h m) (*' H" 2)(»^ -h 1) 


Now a 2 m IS the coefficient of in the series (4) 

for y. Hence it would be convenient if a 2 m contained the factor 
2 *'+sm 111 its denominator instead of just 2^” To achieve this, we 
write 

_ (—I)”* 

“ 2'+«'"m!(i. + m) • (k + 2)ii> + 1) 

Furthermore, the factors 
{v -h m) (v -h 2)(y H- 1) 

suggest a factorial. In fact, if 9 were an integer, a factorial could 
be created by multiplying numerator and denominator by v\ 
However, since p is not necessarily an integer, we must use not 
p\ but its generalization r(i^ -h 1) (Sec. 7.3) for this purpose. 
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(6) 


Then, except for the values 

= -1, -2, -3, . . 

for which r(i' -|- 1) 18 not defined, we can write 
(- 1 )- 




+ «)••(„ + 2)(i- + i)r(y + 1) 

Since the gamma function satisfies the recurrence relation 

zr(j) = r(z + 1) 

the expression for 0 !„ becomes finally 

(- 1 ) 


|2'r(c + noo] 


— 


[2T(. + 


2''+2"w2’r(v -h w + 1)' 

Since Uo IS arbitrary and since we are looking only for particular 
solutions, we choose 

1 

2T(. + 1) 

_ (rJl'l _ 

2«'+?m^^!r(j, -f- 1) 

The senes for y is, therefore, from (4), 


flo 


»<<) - <■ 

-! 


i o\ Oi 




-h 1) 2^^ + 2) ^ 2^+'2»r(i. -f 3) 


2.+2.n,„fr(,, + 4- 1) 


The function defined by this infinite series is known as the 
Bessel function of the first kind of order y and is denoted by the 
symbol Jy{i) f?ince Bessers ecjuatioii of order v has no finite 
singular points except the origin, it follows from Theorem 2, 
Sec 9 1, that the senes for J„(0 converges for all values of t if 
p ^ 0 The graphs of J»(i) and Ji(t) are shown in Fig 9 2 Their 
resemblance to the graphs of cos t and sin t is interesting. In 
particular, they illustrate the important fact that for every value 
of V ihe eciuation JM) ~ 0 has infinitely many real roots 

Let us now consider the series arising from the other root 
of the indicial equation, namely, r — —v. We could, of course, 
begin again with a series analogous to (4) and determine its 
coefficients one by one, just as we did for ^,(0. There is no need 
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(7) 


( 8 ) 


(9) 


( 10 ) 


( 11 ) 


( 12 ) 


to do this, however, for the final result can be obtained at once 
simply by replacing »» by — in the series (6), provided that the 
gamma functions appearing in the denominators of the various 
terms are all defined. This is necessarily the case unless v is an 
integer, hence w'hen v is not an integer the function 


Vy ^ V -b w -b 1) 

m “0 

IS a second particular solution of Bessel’s equation of order v. 
Moreover, since J ^p{t) contains negative powers of t while Jw{t) 
does not, it is obvious that in the neighborhood of the origin 
J^y{t) is unbounded while J y(t) remains finite. Hence Jy(t) and 
J-y(t) cannot be proportional and, therefore, are two independent 
solutions of the Bessel equation According to Theorem 2, Sec 2.1, 
a complete solution of Bessel’s equation when v is not an integer 
18 then 


y{i) = ClJy{t) -b C^J- yU) 

Instead of J^y(t), some writers take Ihe linear combination 

Y (t) = in r J y{t ) - J-y{t) 

sin ^ 

as a second, independent solution of Bessel's equation Using 
Vyit), which is known as the Bessel function of the second kind 
of order r, a complete solution of Bessel’s equation can be 
written, 

y{t) = CiJ y(t) -b C 2 FXO »' not an integer 

In some applications it is conviMiicnl to use still another 
form of the geneial solution of Bessel’s eiiuation This is based 
upon the two particular solutions 

Hy^^\t) = Jy{t) -b tYpiO 

Hy^'^\l) = Jp{t) ~ lYy{t) 

These are known as Hankel functions* or Bessel functions of 
the third kind of order p, and in terms of them a complete solu¬ 
tion of Eq (3) can be written, 

y{t) = C\Hy^^\t) -b V not an integer 

It IS interesting to note that (8), (10), and (12) are correct 
expressions for the general solution of Eq (3) even when v is 
an odd multiple of and the roots of the indicial eiiuation 
— „2 = 0 differ by an integer. In the last section we pointed 
out that, when this happens, a second, independent senes solu¬ 
tion of the form (4) will usually not exist It may exist, how¬ 
ever, and Be-ssel’s equation is one of the instances when it actually 
does t 


* Named for the German mathematician Hermann Hankel (1839-1873). 
t See Kxereme 9, Sec. 9 1. 
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(13) 


If V is an integer, say i' = n, the situation is somewhat differ¬ 
ent. Again the roots of the indicial equation differ by an int-eger, 
namely, 2n, and it is to be expected that a second solution of the 
form (4) will not exist. In fact, considering J-n{t) as the limit 
of J,{t) as V approaches — n and remembering that when its 
argument approaches any nonpositive integer the gamma func¬ 
tion becomes infinite, it follows that as v approaches — n, the 
first n terms in the series (6) approach zero and the series effec¬ 
tively begins with the term for which m = n 



2-'*+2fFi^!r(_n -p ^ i") 


In this, let the vanable of .summation be changed from ni to j 
by the substitution m — j n Then 


j-s) = 2 
,-0 


^»4-2(j+n) 

+ (j ’-f n) -f i] 


2n-H2.r(n 


= (-1)V„(0 


Thus, when v is an integer n, the function J-v{t) proportional 
to Jp{t) These two solution.s are therefore not independent, and 
ti linear combination CiJ,{t) -1- C 2 J-y{t) is no longer a com¬ 
plete solution of Bes.seJ’s equation Moreover, without additional 
definitions, neither (10) nor (12) provides a complete solution, 
since K,(0, defined by (9), assumes the indeterminate form 
0/0 when p is an integer 

A complete solution when p is an integer can be found in 
either of several ways One is to use the method developed in 
Sec, 2 1 for finding a second .solution of a linear second-order 
differential equation when one solution is known The result, as 
given by Eq (fi) of Sec 2.1 with yi(t) — Jn{t) and P{t) — l/fj is 

y(t) = cJnit) f 


The usual procedure, however, is to obtain a second, independent 
solution by evaluating the limit of Yy(t) as > n The details 
are somewhat involved, and w’e shall not present them here 
The limit function, which exrsts and is independent of Jn{t) for 
all values of n, is commonly denoted by Yn(t), that is. 


Y„(t) = lim r.(0 = hm 


cos vtJ,{ t) — J-v{i) 


The corresponding specializations of the Hankel functions (11) 
are defined in the obvious way in terms of K„(f). 


= y„(o + lYnit) 
= J^{t) - lYM 


( 14 ) 
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With Formulas (13) and (14), we can now eliminate from (10) 
and (12) the restriction that v is not an integer and use these 
results for all values of Vy integral as well as nonintegral. Plots 
of Y and 1^1(0 are shown in Fig. 9 3. Among other things, 
they illustrate the important fact that, for all values of j/, Yy{i) 
is unbounded in the neighborhood of the origin and has infinitely 
many real zeros. 



Reversing the transformation (2) which we used to eliminate 
the parameter X from the general form of Bessers equation (1), 
wc can now summarize the results of the preceding d]scus.sion 
in the following theorem 


THEOREM 1 

For all values of v, a complete solution of Bessel’s equation of order v with 
parameter X, 

xV' + xy' -f- (X^Z^ - v'^)y = 0 
can be written in either of the forms 

y{x) = CiJ,(Xx) -h C2 F,(Xz) 
y{x) = CxHy\\x) + C2Hy^^\\x) 

If V IS not an integer, a complete solution can also be written 
y(x) = riJ,(Xx) -h CiJ^y{\x) 

,/^(Xx), /_„(Xx), and F^(Xx) all have infinitely many real zeros If v ^ 0, J,(Xx) 
is finite for all values of x, but J_„(Xx) and F,,(Xx) are unbounded in the neighlior- 
hood of the origin. ///^^Xx) and /f„<*^(Xx) are complex-valued functions when x 
18 real. 

EXERCISES 

1 1^1/1 and yj are any two solutions of Bessel's equation of order Vy show that j/iy'j — y^ya — c/x, 

where c IS a suitable constant (Hint: Recall Abel’s identity from Sec 2.1.) 
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2 By determining the coefficient of \/x on the left-hand Bide, show that 


J— J',Kx)J.,{x) *»-^sin vr 

•kX 

[Hint Use the result of Exercise 1 and the fact that r( 2 )r(l - z) - ir/(8in wz) if z is not 
an integer ] 

3 Tf V IB not an integer, show that J „(j) and J-v{x) have no zeros in common (Hint Use the 
result of f^xercise 2 ) 

4 Show that 

y = ds - J.Ax) f fia)JM dsl 

2 sin UTT L J J J 


IS a particular integial of the norihomogeneous Bessel equation 
x®v" xy‘ -f- {x- — v'^)y = xf{x) 


if V IB not an integer (Hint Use the method of v^anation of parameters and the results of 
Exercise 2 ) 

6 Show that, under the transformation y ^ Bessel’s equation of order v beeoineJi 


4. A ^ 

dn \ Ai^ ) 


u = 0 


Hence show that, for large values of t, solutioiiH of HesHel’s equation are approximately 
desciibed by exjiressions of the form 


sm i 


+ C2 


COS t 


Vt 


[More jireeisely, u an be shown that 



where the symbol means that the limit of the ratio of the two quantities connected by it 
approaches 1 as t becomes infinite j 


9.3 

Modified Bessel functions 


( 1 ) 


Thcie are cert am equations closely resemblmj,^ Besiser.s equation 
which occur so often that their solutions are also named and 
studied as functions in their own right. The most important of 
these IS 


dy .\dy 

dx^ X dx 



= 0 


which is known as the modified Bessel equation of order v. Since 
this can be written in the form 


1 ^ 
dx^ X dx 



= 0 
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it is evident that this is nothing but Bessel's equation of order v 
with the imaginary parameter X = i. However, in actual appli¬ 
cations, to write the complete solution of (1) in the form 


y = CiJ,{tx) + c^Y ,{ix) 

and retain the imaginaries would be about as awkward as to 
take the solution of 



0 


to be y = Cl cos tx -|- C 2 sin tx 

and use this complex expression instead of resorting to real 
exponentials or hyperbolic functions. Accordingly, we seek modi- 
ficatipns of J^{ix) and Y^{tx) which will be real functions of real 
variables 


Now, J^{tx) = ^ 




-h A: -h 1) 




-f /r -f 1) 


Moreover, J^{'ix) multiplied hv any constant will also be a solu¬ 
tion of the equation we are considering Heiu-e, in particular, 
we can multiply it by i \ getting 


^ jP+2* 

x-’j,(tx) = ^2^ ^^r(7+ ^i-T) 

This 18 a completely real function, identical with </„(x) except 
that its terms, instead of alternating m sign, are all positive 
This new function, which is related to J^{x) in the same way that 
cosh x and sinh x are related to cos x and sin x, is known as the 
modified Bessel function of the first kind of order v, U{x). If v 
18 not an integer, the function I^y{x) obtained from /„(x) by 
replacing by —throughout is a second, independent solution 
of Eq (1), whose complete solution can therefore be written 

y = cj,{x) + C2l-y(x) 

On the other hand, instead of using many writers 

take the second solution of the modified Bessel equation to be 
the linear combination 

K,ix) = 5 • 

2 Sin vT 

which is known as the modified Bessel function of the second 
kind of order v If is not an integer, this is a well-defined 
solution which is clearly independent of Iy{x) If v is an integer n, 
this assumes the indeterminate form 0/0, but a tedious evalua- 
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tion by L’Kospital’s rule leads to a limiting expression 
Kn(x) = lim K,(x) = lim ^ 

¥—^n w—*n " Sin VTT 

which is a solution independent of /n(x). This is a useful result, 
because, as we might expect, 7»(j) and I-,(x) are not independ¬ 
ent when V is an integer. In fact, when */ = n, we have the identity 

( —= Jn(ix) 

and then, by obvious steps, 

= l~^Jn{lx) 

/_„(x) = K{x) 

Plots of l{s{x) and l\{x) are shown in Fig 9 4, plots of /Co(a*) 
and in Kig 9 5 As these graphs illustrate, the modified 

Bessel functions have no real zeros except possibly j = 0. They 
also illustrate that, for ^ 0, J,{i) is finite at the origin, but 
K,{x), like becomes inhnite as x approaches zero 

Just as the ordinary Bessel equation, so the modified Bessel 
equation freijuently occurs in a form containing a parameter X: 



A complete solution of this is, of course, 
t! =r c\h{\x) + C 2 A.(Xj) V unrestricted 
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FIGURE 9.5 

Plot showing 
the modified 
Bessel functions 
of the second 
kind Ko(x) and 
KAx). 



X 


If u is not an integer, wc have the alternative form 
y = cj,{\x) -h C 2 l-y(\x) 

A second equation closely related to Bessel’s equation is 



Thi'« can be regarded either as Bessel’s equation of order v with 
parameter X = ± \/ —i or as the modified Bessel equation of 
order u with parameter X — ± \/t From the former point of 
view a comjilete solution can be written 

y = CiJA± y/~tx) + C 2 Kv(± \/~ix) 

From the second point of view the solution can be written 

y = djy{± y/ 1 x) d^Kyi ± y/ix) 

Now a complete solution can be constructed from any pair of in- 
de})endent particular solutions, and it is customary in studying 
Eq (3) to select ./„( ± y/x) and Ky{ ± y /1 x) for this purpose 
The solution becomes unambiguous when a choice is made 
between the two square roots in each case Naturally enough, 
the positive, or principal, square roots are chosen Then since* 

7 = cos 2 “f" ^ ^ —1 = cos ^ -h 7 sin ^ 

it follows that 


See Formula (7), Sec 14 7. 


SEC 9.3 


MODIFIED BESSEL FUNCTIONS 


Ml 


and we have for the complete solution 

y = cJ,{t^x) + dK,(i^x) 


Now 




J,{i^x) + A: + 1) 

= I../. Y 

L 2'+*‘A:'r(v + k + 


1 ) 


Moreover, ran take on only one of the four values 


1 = 0, 4, 8, . . 

-t fc = 1, 5, 9, . 

-1 fc = 2 , 6 , 10 , . 

i fc = 3, 7, 11, . 

Hence, the first, third, hfth, terms in are real, and 

the second, fouith, sixth, arc imaginary. Separating the 
senes into its real and imaginary parts, we obtain 




S 2'+^'(2 

Lj-O ^ • 




-f ? 


V 

Lt 


(-l)^x^+2+4y 

2.+2f4;(2^ H- l)ir(;. f 27+“ 2 ) 


-■'■'•IL + 'I] 

rurlherniore, 

/ilT V MtT V 

^3./2 = (g»r/2)3./? ^ ^.3„r./4 = ^ 

4 4 


and, therefore. 



J thus consists of one purely real series plus i times a 
second purely real senes. The aeries forming the real part of this 
expression defines the function ber„ x. The series forming the 
imaginary part defines the function bei„ x. The letters be suggest 
the relation between these new functions and the Bessel functions 
themselves. The terminal letters r and t, of course, suggest the 
adjectives real and imaginary For the important case */ = 0, 
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we have explicitly 


hero X = her 2: = ^ 


j-O 


2H(2j)\V 


beio a: = bei j = ^ 


(_l).^4.+2 
24i+2[(2j -h' 1)»]^ 


Plots of ber x and bei x are shown in Fig 9.6 The graphs oscillate 
with ever-increasing amplitudes. 



In a similar way the function K,{i^*^x) can be expressed as a 
real senes plus i times another real series These senes are taken 
as the definitions of the new functions ker„ x and kei^ j, respec¬ 
tively. A complete solution of Eq (3) can thus be written 

y — c(ber^ x -f- ^ bcu x) -f d(ker, x i keu x) 

The function ber^ x t bei„ x is finite at the origin, but becomes 
infinite as x becomes infinite, ker,, x -|- ? kei„ x is infinite at the 
origin, but approaches zero as x becomes infinite 

EXERCISES 

1 Show that J,{r^x) = ber^ x — i bei^ x 

2 Show that Jo(i^x) >= ber x — f bei x Is “ l>er, x — i bei^ x in ji^encral? 

8 Show that (x ber' x)' » — x bei x and that (x bei' x)' =“ x her x 

i Write out beri x and bcii x 

6 Show that, under the transformation y = uf\/xt the modified Bessel equation of order v 
becomes 
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Hence show that, for large values of x, solutions of the modified Bessel equation are approxi¬ 
mately described by expressions of the form 

e-* e- 

(More precisely, it can be shown that, as x becomes infinite, 



9.4 

Equations reducible to Bessel's equation 

There are many differential equations whose solutions can be 
expressed in terms of Bessel functions In particular, we have 
the large and important family described in the following theorem 


THEOREM 1 

If (1 — a)^ ^ 4c and if neither d, p, nor q is zero, then, except in the obvious 
special cases when it reduces to Euler’s equation,* the differential equation 

x^y" -f x(a -f 2bx^)y' + [c -1- 4- b(a -f p — l)x^ + b^x^^\y = 0 

has as a complete solution 


where 


y = x“e-^**’[ciy,(Xx«) 4- C 2 K,(Xx«)] 

I -a b ^ •\/\d\ - ay - 4c 

2 p q 2q 


If d < 0, and K, are to be replaced by and respectively If v is not an 
integer, and Ky can be replaced by and I if desired 


The proof of this theorem, while straightforward, is lengthy and 
involved, and we shall not present it here. It consists in transform¬ 
ing the given ecjuation by means of the substitutions 

y = j(l--a)/2g-(6/p)zi>y j. ~ 

\V|d| 

and verifying that, when the parameters are properly identified, 
the result is precisely Bessel’s equation. 

One special case of Theorem 1 is of sufficient interest to be 
stated as a corollary 



COROLLARY 1 

If (1 — r) 2 ^ 46, if a 7 ^ 0, and if either s>r — 2 or 6 = 0, then a complete solu¬ 
tion of the equation 

(x^yy 4 “ {ax* 4 - bx^-^)y = 0 
is y = xf[ciJy{\x^) 4- 


Equation (10), Sec. 2.6. 
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where 

1 — r 2 — r-l-s ^ 2 y/\a\ _ \/(l — r)^ — 46 

“ = ~ 2 - ^ ^ = 2^T+1 " = —t:i-7T“ 

If a < 0, and Yy are to be replaced by 7„ and Ky, respectively If v is not an 

integer, Yy and K, can be replaced by J-y and if desired. 

EXAMPLE 1 

Find a complete solution of the equation 

z{4x* — ^)y' -f (4x* — 5x* + 3)v - 0 
Clearly, this is a special case of the equation of Theorem 1 with 

a ■» —3 6«=2 p = 4 c“3 —5 g “ 1 

Hence, tt“2 \/1 “Sj •» y/ 5 and = 1 

A complete solution is, therefore, 

y “ 5 x) + fjAi(\/5 x)] 


EXAMPLE 2 

What IS a complete solution of the equation j/" + p = 0*'* 

Obviously, one possibility is 

j/ — Cl cos X Cl sm X 

However, y" -f ?/ ■= 0 is nlso a special case of the equation of Corollary 1, with r -* 0, s “ 0, 
a »■ 1, and 6 — 0 Hence, 

a ms 7“1 X*“l = 

and so we can also write 


V ~ di\/x J\,i(T) -f- dj \/x J-x^(t) 

It follows, therefore, from Theorem 2, Sec 2 1, that, for proper choice of the constants Ci and Cj, 
each of the particular solutions 

\/xJ^^{x) and V^x ./_^(x) 

must be expressible in the form Ci cos x -f- r 2 sin x 

Now, since r(?^) - *■ ^2 v, the aeries for beRins with the term 


12 : 

MH) " \ - 


Hence, the senes for y/x d^j(x) begins with the term \/2/7r x Therefore, if we write 


V xJ^(x) - 


Cl cos X -f- C 2 sin x 


and put X — 0 m this identity, we find f| “ 0 Subsequently, by equating the coefticients of x, 
we find 




We have thus established the interesting and important result that 


\/x 


sin X or ^ — sm x 

r ■ \ irX 
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In a similar manner it can be shown that 




EXERCISES 


Find a complete solution of each of the following equations 


1 

3 

6 

7 


y/f j.my rS 0 

x^y" + 3xy' -h (I -f- x)y » 0 

+ 2x^y' + (x* + x® — ‘2)y *• 0 
Show that 





sinh X 


0 Show that any solution of 


2 xy" -}- 2y' + Axy = 0 
4 ly" - y' 4x»?/ » 0 
6 xhj" -f (2x* + x)y' -f- (x* -f 3x 


and 




S 


cosh . 


(x*" ^y^)' = /ex’" *?/ or (x"* ^y'V = ~kx”'~*y 


w'lll also satisfy the equation (x’"?/")" = k^x^~hj 
9 What IS a complete solution of {xhf")" = Oi/? 

10 What IS a complete solution of xhj^^ + ^xy'" -f I2y" — y = 0^ 


Oy - 0 


9.5 

Identitiei for the Bessel functions 

Til Bobsel functions aie rclatcil by Jin anuizing array of identities. 
Fundamental aniorj^< these are the consequences of the following 
pair of theorems 


THEOREM 1 


'dx ^ 


PROOF To prove this theorem, we take the senes for multiply it by jt", 

and differentiate it term by term 

(-l)V 


■''W - I 2^+'‘A'r(r + k -I- i) 


x^J .(.r) ^ o.+'a 


%'r(r + \ +“l) 


d[x’ . J.(x)] ^ Y ( -l)*2(r + >-»*- ■ 

dx 


.2 2'+'«e('' + k)r(v + ic) 


= 2 2V 




■-•“A-TCr - 1 + A: + 1) 


= ^'2 2^ 


(_l)*2..-l+2fc 


- 1 + A: -h 1) 


as asserted. 
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THEOREM 2 


d[x-^J.{x)] 

dx 




PROOF Theorem 2 can be proved in essentially the same manner as Theorem 
1, but it is easier and perhaps more instructive to proceed as follows By perform¬ 
ing the indicated differentiations and simplifying, we can verify at once that the 
differential equation 


A 

dx 




djx'y) ' 

dx 


4 - x^-''y = 0 


18 precisely Bessel’s equation of order v and is, therefore, satisfied by the particular 
solution 


y = J,{x) 


Hence, substituting, we have 

Now, using the result of Theorem 1, this can be written 
^ = -xW.(x) 

or ^ [x‘ 'J,_i(x)I = -x' 


Finally, replacing »/ by v 1, we have the assertion of Theorem 2 


By using their definitions in terms of Jy{x) and J-^{x), one 
can readily show that the Bessel functions of the second kind F„(j:) 
and the Ilankel functions Hf^^{x) and also satisfy the 

identities of Theorems 1 and 2. Furthermore, by arguments similar 
to those wo have just used, the following theorems can be 
established. 


THEOREM 3 

^[x’/,(x)l = x'/,_i(x) 

THEOREM 4 

^ [x-'f,(i)] = x-'/,+,(i) 

THEOREM 5 

THEOREM 6 

^ [i“'iir,(x)] = -x-’X',+,(i) 
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Performing the differentiations in the identities of Theorems 
1 and 2, we obtain, respectively, 

X’j'Xx) + vx'-U,{x) = x’J,-i(x) 
xr’j[{x) - vx —V.(i) = 

or, dividing the first of these by x’ and multiplying the second 
by X’ and solving for J',(x) in each case, 

(1) J'M = ^ J,(x) 

( 2 ) J'Xx) =^J,{x) -J,^,(x) 

Adding these and dividing by 2, we obtain a third formula for 

(3) J’Xx) = 

Subtracting (2) from (1) gives the important recurrence 
formula 

Jp-i(x) 4- Jp^-iix) = — Jy{x) 

X 

Written as 

(4) Jp-^\{x) = ~ Jy{x) — 

th. formula .serves to express Bessel functions of higher ordeis 
in terms of functions of lower orders, frequently a useful manipu¬ 
lation Written as 

(5) J.{x) - J.+.(x) 

it serves similarly to express Bessel function.s of large negative' 
orders (for instance) in terms of Be.ssel functions whose ordeis 
are numerically smaller 

EXAMPLE 1 

Express J^,{ax) in terms of Jo{ax) and Ji{ax) 

Taking v »* 3 in (4), we first have 

g 

Jiiax) » — Jaidx) — Jaiax) 
ax 

Applying (4) again to Ja{ax) and then to Ji{ax), we have further 

Ji{ax) * — -i J,{ax) - J\{ax) — Ji{ax) 
ax \^ax J 

- ( - 1 ) ‘^*(®^) - —'f 1 ( 02 :) 

\a>a:* / ax 

- (^. - 1 ) 
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EXAMPLE 2 

Qi ■!_ . d\xJwr T a/ \ r* / M 

Show that - - — Jl+i(x)j 

dx 

Performing the differentiation, we have 

+ xJ,(x)f,Ux) 
dx 

Then, Bubstituting for xJ[{x) from (2) and for xJ',^x^x) from (1), we have 

^xJp{x)Jy^l{x) ] ^ J^{^x)Jv^\{x) -}- Jp^y{x)[vJ „(j) — + Jv{x)[xJt,{x) — (v \)J .-+l(x)] 

dx 

- x{J>\x) - 

The basic differentiation identities of Theorems 1 and 2, 
when written as integration formulas 

(6) dx = x*Jt,(x) -j- c 

(7) ^x-*Jdx = — x-’’J„(x) + c 

suffice for the integration of numerous simple expressions involv¬ 
ing Bessel functions For example, taking v = 1 m (6), we have 

/x./o(x) dx = xJ lix) + c 
Similarly, taking »/ = 0 in (7), we find 
SJ](x) dx = —Jq{x) + f 

Usually, however, mtegratioit by parts must be used in addition 
to (6) and (7). 

EXAMPLE 3 

What 18 iJi{x) dx^ 

If we multiply and divide the integrand by x’, we have ^x^\x~^Ji{x)] dx, and bo, integrating 
by parts with 

w — X* dv = x~*Ji{x) dx 

du “ 2x dx V “ —x“V 2 (x) [by (7), with i/ - 2] 

we have ^Ji{x)dx <= —di(x) -f 2 /x~t/ 2 (x) dx 

- —Ji{x) — 2x~^Ji{x) c [by (7), with i/ — 1) 

EXAMPLE 4 

What IB /[/a(3x)/x*] dx? 

Here it 18 convenient to multiply the numerator and denominator of the integrand by 9x*, 
getting 

^ f (3x)>/a(3x)“ 

9 7 x^ 

Now, integrating by parts with 

u - (3x)V2(3x) dv - — 

X* 

du “ (3x)Vi(3x) 3 dx v --^ 

3x* 
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we have 


f Ji( 3 x) 1 |~ 3/2(83;) f dxl 

9 [ - -i-' + 3 / 3xy.(3x) - J 


Again using integration by parts, with 
u — 3x/i(3a:) 




du “ 3x/oC3j)3 dx 


> have further 


[ /2(3x) ] ( 3/2(3x) r f -| I 

j ~~2 - = 9 I-7“ + [ -3^.(3x) + 9 J Jo(3x) dxj I 

Ji(3x) f 

- — -/,(3t) + 3 j /o(3x) di 

The residual integral fJoiSx) dx cannot bo evaluated in finite form 
In general, an integral of the form 
fx^'Jnix) dx 

where vi and ri are integers such that m -h n ^ 0, can be com¬ 
pletely integrated if m -f n is odd, but will ultimately depend 
upon the residual integial /./o(-0 dx if w + n is even For this 
reason Jo(t) dt has now been tabulated * 

Another class of identities of considerable interest can be 
obtained from the expansion of the function 


( 8 ) 


exp 


-^('-01 


pxtt2p~zl2t 


in terms of powers of / To derive this expansion we first replace 
the ('xponentials on the right of (8) by their infinite senes, getting 


v.4^ ' 2 -; 1 ^ 4 '7^ 


Now when these series are multiplied together, we obtain a 
term containing f" (n ^ 0) when and only when the general term 
m the second series, 1 e , the term containing f' is multiplied hy 
(he term in the first series which contains <’*+', 1 e , the term for 
which 2 =--71+7 Therefore, taking into account all possible values 
of j, we find that the total coefficient of 111 the product of the 
two series is 


X r 1 r(— 1 )^ _ Y (— 1 ) 

^_oL(^ -h jj] 2^\~ 




+ ; + 1) 


= Jn{x) 


Similarly, a term containing i " arises when and only when the 
general term in the first series, 1 e , the term containing is 

“* A N. Lowan and Milton Abramowitz, “Tables of Integrals of /o(0 dt 

and jf Ko (0 dt,” MT 20, Superintendent of Documents, Government 
Printmg Office, Washington, D.C, 
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multiplied by the term in the second senes which contains 
i.e., the term for which 7 = n + t. Therefore, taking into account 
all possible values of i, we find that the total coefficient of m 
the product of the two series is 

Y / I r\ _ Y 

L 27 (n -h t)\ ^ ^ I, 2'*+2^t!r(n + i + 1) 

= (-l)V„(x) 

Hence, 

( 9 ) exp (t - ^ ./„(i)[r + (-DT"] 

n - 1 

Now let t = so that 

1 /. l\ e^* — 

2 V - 7; = ~- 2 — = * * 

and exp j = e'”'"* = cos (i sin <t>) + t sin {x sin <)>) 

In the same way, when n is even, say n = 2k, we have 

r + {-lyn « == ^ ^ =, 2 COS 2 /f<^ 

and, when n is odd, say n — 2k — 1, we have 

= ^2* 1 _j_ 2A.+ 1 _ g»(2*-l)(^ _ ^,-i(2;r-l)« 

= 2i Sin (2k'— 1 )0 
Therefore Kq. ( 9 ) can be written 
g.iBin* — gjjj </>) -h I sin {x sin 4>) 

= Ji)(x) “b 2 ^ ./2*(:r) cos 2k(l> 2i ^ J2k^-i{x) sin (2k — 1)0 

*-i 

Equating real and imaginary parts in the last expression, w(i 
obtain the identities 

(10) cos (x sin 0) = Jo(x) + 2 ^ J2k(x) cos 2k<t> 

jfc = i 

(11) sin (x sin 0) = 2 ^ yat_](x) sin {2k — 1)0 

A-i 

The series on the right in (10) and (11) are, of course, just the 
Fourier expansions of the functions on the left 

Now multiply both sides of ( 10 ) by cos n<t> and both sides of 
(11) by sin n0, and integrate each identity witli respect to 0 from 
0 to IT. Since 

cos m0 cos n4>d^ = am m0 sin n0 d0 = 0 m ^ n 
cos* n<f>d<t> — sin* n<l>d4> = ^ 
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02 ) 


this yields 

f cos n<f> cos {X sin 4>) d4> = | ^ 

(On oda 

/;smn.>sin(.s.n^)d0= | 


If we add these two expressions and divide b> tt, we have, for all 
integral values of n, 

Jn(x) = ~ f [cos n<t> cos (x sin </>) + sm sin (x sin 0)) d(l> 

TT JO 


since, for every value of n, one or the other of f he integrals vanishes 
while the remaining one contributes J„(j) Finally, using the 
formula for the cosine of the difference of two (juantities, we have 

Jn{x) = - /""^ cos (n0 ~ X sin 4>) d<i> n an integer 

TT JO 


EXERCISES 

1 Express Jf,{x) in terms of Jo(x) and J\{x) 

2 Express and in terms of sin x and cos x 


O WU . d[x^J^Clx)]^ 

3 W hat 18 -^ 

dx 


A . d{xJo{X^)]^ 

4 What IS-? 

fix 


K CU XL ^d[x^J^ 't)J,+ i{x)\ (IJ,{X) 

6 Show that- --= 2x^Jv{x) -- 

dx dx 

6 Prove Theorem 2 hy using the series expansion for Jy{x) 

7 Show that 

a Aj';{x) - - 2J,{x) + J,yz{x) 

b 8J';'(j) - J,.,{x) - 3J._,(jc) -h 3./,+ ,(x) - J.^iix) 

8 Show that J'^{x) = ^ ~ ^ j 

9 Show that Jq{x) =‘ - f cos (x cos <p) d0 

IT Jo 

10 By expanding the integrand into an infinite series and integrating term by term, show that 
»/2 _ _ sm j . /■ ir/Z , . . . 1 — cos X 


r 


Jo(x cos 0) cos 0 d0 =- 


fw/2 

b / Ji{x cos 0) d0 


11 Show that /yo(x) dx = 2[/,(x) + Ji{x) -f ^b(x) + 1 [Hinf Use Formula (3) i 

12 Show that 


j Jo{x) dx =■ Ji(x) + j —— dx 

_ + 3 f 

X J x^ 


dx 


Jzix) 


J^{x) + ^ J^ix) -hi 3 5 J '^dx 


1 3 


- J.(l) + ^ J.(x) + 


(2n-2)!J,(i) (2n)\ r J.M 

2"-'(n - 2~n\ J i" 


dx 


[Hint” Use repeated integration by parts, each time taking dv ■» dx ] 
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18 


14 

16 

16 

17 

18 

16 

20 


21 


22 

24 


26 


CJL. i.u A r r */ \ I 9 •/in-l(^)«/fii + l(3^) "I 

Show that j xJfn*{x) dx \ -^-+ c 

(Hint After integrating by parts, the result of Exercise 5 may be helpful.) 
Show that ^Jsi{x) cos x dx xJoix) cos x + xJi(x) sin x + c 

Show that JJo{x) sin x di - xJo(x) sin x — xJi(x) cos x -1- c 

Show that jJ]{x) cos x dx - xJi(x) cos x — J(i{x){x sin x H- cos x) + c 

Show that //i(x) sin x dx = x./i(x) sin x + do(x)(x cos x — sin x) H- c 

What is 

a jxJoix) cos X dx^ b /x./i(x) sin x dx^ 

What is 

a /xJo(x) sin X dx? b /xdi (x) cos x dx7 

Show that 

a /xJo(x) dx - x./i(x) + c 

b /x’Jo(x) dx »■ x*di(x) + xJoix) — jJoix) dx -h c 
c /x*do(x) dx “ (x* — 4x)Ji(x) + 2x^Jo{x) + c 

d fx*Jo(x) dx = (x* — 9x*)di(x) -h (l^x* — 9x)do(x) -t' 9/do(x) dx + c 

Show that 

a y dx “ — Ji(x) -b y do(x) dx -f r 

b /diCa-) dx - ~do(x) + c 
c /iJi(x) (ix = —xJoix) -|- /./o(x) dx + c 
d /x®di(x) dr => 2xdi(x) — x^Joix) -|- c 

e /x*di(j) dr * :^xVi(x) — (x® — ,fx)Jo(:c) — lifJoU) dx -f- c 

f /xV.(x) dx =» (4x* — 16x)Ji(x) — (x® — Hx^)Jo(x) + c 

What 18 /xdjCl - x) dx? 28 What is fJu(\^x) dx’ 

Show that 


a ll(x) - /,.-i(x) - " /„(x) 

X 

. (x) 4- /t«+i(x) 

c /.W - - - --- 

What 18 
a /x/o(x)dx? 
c fx/](x) dx? 


b /;(!) - ^ /.{*) + 

d Iv-\{X) - Iy + \{X) - 

b /x®/o(x)dx? 
d Jx'hix) dx? 


9.6 

Orthogonality of the Bessel functions 


a) 


If we write Hessel’s equation of order v in the form 


_^J,dy 
dxi ^ di^ 




it 18 clear that it is a special case, with 

y2 

p(x) = X q(x) =- r{x) = x 

X 


and X* written in place of X, of the general equation covered by 
Theorem 4, Sec 8 5 If the solutions of Bessel's equation satisfy 
boundary conditions of the form 


A^y,0^^) 


„ dy,(\x) 


|x— 


0 i = 1, 2 
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( 2 ) 

(■■i) 


( 4 ) 


( 5 ) 

( 6 ) 


they must, therefore, be orthogonal with respect to the weight 
function p(x) = x over the interval (xi,a: 2 ).t 

For practical purposes, however, it is not enough to know 
that the characteristic functions of a problem are orthogonal. 
In order to carry out the expansions required at the final stage 
of a typical boundary value problem, it is also necessary to know 
the value of the integral of the product of the weight function 
and the square of the general characteristic function, taken over 
the interval of the problem 

We begin this calculation by considering the indefinite 
integral Sty.'^it) dt where ?/,(0 is atiy solution of Bessel’s equation, 
1 e , 


+ ty[ -f - v‘^)y, = 0 

If Eq (2) IS multiplied by vl and then integrated, we obtain 
dt -h ll{y[)'^ (it -h ^i-y^y^dt - v'^^y,y\dt = 0 
Now, evaluating the first and third in'f'grals by parts, we have 


dt 


1 i = <* dv •^VvVv" 
du = 2tdt » =(j/i/)’ 


- ftiyiv dt 


■' “ " u-l' dv 

du * 2l dt i' = 


VuV,' dt 


- Sty.^di 


Then, nuh.slituUng tlie.se results '.nto Eq (3), we find 
[ - St(y:rdl] + Hiy^dt 4 - Jty^'dt) 


- = 0 

or, collecting terms and solving for 

j ly,\t) dt = -J - .^)v,Hf) + I 

If we now put / ^ X„,x, where is any one of the characteristic 
values for which solutions satisfying the boundary conditions 
exist, and then divide by X,„^, wc obtain the integral in which we 
are actually interested 

j xy,^{\mx) dx = 2^-^ |(X„^j* — v^)y,^{Knx) -f j | 

The evaluation of (4) between the specific limits Ti and X 2 
requires the consideration of several special cases, according as 
in the boundary conditions (1) is or is not equal to zero. If 
B, - 0, then (1) becomes simply 


y.{XmX^) = 0 


and the antiderivative on the right of (4) reduces to 

I ^ r di/,(X,n3:)]'‘^ I 
2 X« 2 ^’ [ dx J 


t Since r(a:) ^ x vanishes when x ■> 0, it follows from the proof of Theorem 4, 
Sec 8.6, that if a:i - 0, no boundary condition will be needed (and none 
will be available) at x — x\ 
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This can be further simplified by recalling from the preceding 
section that all solutions of Bessel’s equation Yy, 

and as well as arbitrary linear combinations of these func¬ 

tions, satisfy the identity 

or X = vy^O^mx) — KnX y,+ li\mX) 


Evaluating this at x = x, and using (5), we find 


dyy(\nx) 

dx X - 1 . 




and so (6) becomes simply 


On the other hand, if B* 0, then we can substitute for the 
derivative on the nght of Eq (4), getting 

e^[(x.,.).-.. + (5^y] 

The results of the preceding discussion are summarized in 
the following important theorem 


THEOREM 1 

The solutions of Bessel’s equation of order y which satisfy the boundary conditions 

dy,(Xx) I 


A,yy(\x,) - B, 


dx 


= 0 


1,2 


form an orthogonal system with respect to the weight function x over the interval 
(xi,X 2 ) The integral of the product of^the w^eight function and the square of any 
solution of the system {t/.(Xmx)l, i e., 


is equal to 




xyy*{X„,x) dx 


yr^iXnyXi) 

2K^ 

(Kx,y -■'* + ! 

(t)’] 





yyHK,xi) r 
2X..* [ 

(X«X,)2 - 


B 1 B 2 

0 

y.^iKxi) 

2K,' 

(\„x,y - +1 

(t)1 

- ^ yl+iO^^i) 






B. 

= 0, B 2 

0 


[ (X.,Xi)* 







Bi 

^ 0, B 2 

= 0 


Xi* 

-*!!) - -2 

B\ = B 2 

= 0 


If Xi ^ 0, no boundary condition is needed at x = Xi, and the contribution to 
thD integral from the lower limit is zero. 
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EXAMPLE 1 

Expand fix) "" Ax — x* over the interval (0,2) in terms of the Bessel functions of the first kind 
of order 1 which satisfy the boundary condition 

JiiXx) - 0 

Iz — 2 

In this case the characteristic values are the values nf X determined by the roots of the 
equation 

Ji{2\) - 0 

Now the roots of the equation Ji(z) — 0 are* 

2o “ 0 2, “ 3 832 2j - 7 016 2* - 10 174 24 “ 13 324 

Hence, Xo - 0 X, - 1 916 Xi =» 3 508 X, = 5 08/ X, » 6 662 

Therefore, since /i(Xox) s ^iCO) = 0, the characteristic functions in terms of which the r<pan- 
Hion 18 to be carried out are 

7i(Xii) JiiXix) Ji{X»x) Ji(\tx) 

As in the simpler case of Fourier expansioiiR, we begin by writing 

fix) 4x — X* ™ A\J\(Xix) -h AtJiiXzx) -I -j- AliX^x) -F 

Multiplying both aides of this expression by xJiiXmX), integrating from 0 to 2, and using the 
results of Theorem 1, we have 

(Ax — X')xj i(XmX) dx T/l*(X,„T)dl =» 2A,„/j*(2Xm) 


f 


(4j* - x*)JiiX^x)dx 


2J^\2X„) 


Hence I 

For the integral 

4 z'J,{\„x)<li 

we have immediately, from Kq (6), Sec 9 5, 


4 /•2 

/ (K,x)Kj 

Xr„’ Jo 


./i(X„x) d(XmJ) 


To evaluate 


c 


- (X„x)V,(X,i) ^ 

I 


x*JjiX„x) dx 


— r ( 

X,n‘ Jo 


X^x)*JdX^x)diX^x) 


I /■2X„. 


we use integration by parts, with 

u = <* dv = fV.ro dl 

du ” 21 dt e “ i^Jiil) 

r„. rs if |2x-, r2\^ I 

This gives x^Jd'Xmx) » — /V^CO ^ jo 

» ^ [i*JM - 2t>JM]l^- 


16 


” [X»r'/l(2Xwi) — y|(2Xm)l 


* See, for instance, Eugene Jahnke, Fritz Emde, and Friedrich Losch, 
"Tables of Higher Functions," 6th ed , p 193, McGraw-Hill Book (Company. 
New York, 1960 
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Thus, (X„y.(2X.) - 7,(2X„)) 

ZJi\Z\,n) [Am Am I 

But, by Formula (4), Sec 9 5, 

y,(2X„) - -i- J,(2X„) - /,(2X„) - 


8J. (2X„) 

X„V,>(2X„) 


Since tile X’s were determined by the condition that yi(2X,„) = 0. Therefore A„ can be further 
simplified to 

X il— 

” X„V,(2X,„) 

The same reduction can be repeated for Jjf'iXm), since 


J a(^Xm) 


_2 

2X, 


«/l(2Xm) ~ o(2Xm) 


Hence, finally. Am 


16 

Xm**A o(2Xm) 


— J o(2Xm) 


The required expansion is, therefore, 


4i — x‘ 



•f l(XmX) 

Xm*«/ o(2Xm) 


Plots showing the degree to which the first term and the first two terms of this senes approxi¬ 
mate 4x — X* are shown iii Fig 9 7 


FIGURE 9.7 

Plot showing 
the approxima¬ 
tion of a func¬ 
tion by the first 
two terms of a 
Bessel function 
expansion. 




EXERCISES 

1 Expand/(x) — 1 over the interval (0,3) in terms of the functions yo(Xmx), where the X's are 
determined by yo(3X) — 0. 

S Expand /(x) — 1 over the interval (0,3) m terms of the functions where the X’s 

are determined by Ji(3X) ■= 0 
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S Expand f(x) — x over the interval (0,2) in terms of the functions JilX^x), where the X's 
arc determined by Ji(2\) — 0 

4 Expand f(x) - over the interval (0,3) in terms of the functions Jo{\mx) where the X’s 


1 * MU 1 

are determined by-,-— 

dx 


0 


6 FJxpand/(x) — r* over the interval (0,1) in terms of the functions where the X’s 

are determined by /^(X) — 0 
C Expand 


fix) 


X 0 < X < 1 

0 1 < X < 2 


in terms of the functions Ji(Kmx), where the X’s are determined by 
dJ\{\x) I 


dx 


0 


7 Expand f{x) == 1 over the interval (0,3) in terms of tlie functions Jai^mx), where the X’s 
are determined by 

dx k = 3 


8 UsiniJ; tables of the Bessel functions, eompute the first tv. o charaetenstic values in Exercise 7 
correct to two decimal places 

9 If (he boundary conditions in Theorem 1 are of the form 0 at x ■= 1 and at x ■« 5, 

what 18 the equation satisfied by the charaeteristie values iXml"^ 

10 Does Theorem 1 have a counterpait for the modified Bessel equation''' Why? 


9.7 

Applications of Bessel functions 

Bessel functions occur in a great many practical problems. In 
principle they are always to be expected when partial differential 
equations are applied to configurations possessing circular sym¬ 
metry. On the other hand, they also arise in numerous applica¬ 
tions where neither circular .symmetry nor partial differential 
equations arc involved In this section we shall conclude our 
treatment of Bessel functions by discussing a variety of problems 
where their use is required 

EXAMPLE ] 

What 18 £{pj„(x<)) if „ ^ 0? 

It IS possible to determine the required transform by expressing as an infinite senes 

and then taking the transform term by term However, it is more instructive to proceed as 
follows: 

From Oirollary 1 of Theorem 1, Sec 9 4, it is clear that j/ = t'^Jy{\t) is a solution of the 
differential equation 


that IS, 


(B'*"!/')' + - 0 

ty'^ + (1 - 2y)y' + \Hy - 0 
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If we take the Laplace transform of this equation, recalling Theorem 7, Sec. 7.4, we obtain 

d d 

- +(1 - 2v)(sjE|i/) - Vo) - V-JC|y) 

da da 

d£>\v\ d£,\y\ 

- -a* - 2 a£{v] + yo + (1 - 2 v){ 8 Z\y] - yo) - 

da da 

d£\v\ 

- -(a* + X>)~^ - (1 + 2y)8£{y\ + 2ki/o - 0 

da 

Now, if ^ 0, the term 2vyo vanishes identically, because either “ 0 or else 
yo - rJ,(xo|^_Q - 0 

Hence, the last equation reduces to the separable differential equation 
d£>\y\ a da 

Integrating this, we have 


1 -I- 

In £(|/) + —-— In (a* -|- X*) — In c 


and, therefore, £|y} 

(s’ 




To determine c we consider the leading term on each side of the last equality. 


^ (2''r(»^ + 1) )} * (s’ -h 


_ x*' _ r T{2p + 1) ^ 1 C 


Hence, since this must be an identity, we find 
X> T(2i> + 1 ) 

T'r(7TT)' 


JE(<'7„(X0) -- — ——-— V ^ {) 

2''r(i.+ !)(«> 4-X«)(»^+‘)/* 

Numerous other transform formulas can be obtained from ( 1 ). For instance, since, from (1), 


it follows that 


£l*/o(X 01 ——and 

V fi’ -h X’ 


JE|J,(X0| 


1 d/o(XO 
dt 


[sjE|yi<\<)i -J^o(o)j 


1 / » _ A _ i / V»* + - » \ 

^ \\/«* + X» / ^ \ Vs’ + X’ / 


V«’ + X* (a 4 V«’ -h X>) 

Oilier results will be found among the exercises. 
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EXAMPLE 2 

A uniform, perfectly flexible cable of length I and weight per unit length w hangs by one end 
from a fnctioulees hook At < - 0 , while the cable is at rest in a vertical position, a uniform 
horizontal velocity v is imparted to the portion of the cable between :r “ 0 and x al (Fig 9 8 ). 
Find the expression describing the subsequent motion of the cable 

This 18 essentially the problem of the vibrating string discussed in Sec 8 2 except for one 
important difference Here, instead of being constant, the tension at a general point of the cable 
IS equal to the weight wx of the portion of the cable below that point Hence, in this case Eq ( 1 ), 
Sec 8 2, becomes in the limit 



g dt^ dx 


As usual, we assume a product solution // ™ X{x)7\t) and Htt^mpt to separate variables. 
Then, substituting, we have 

T"X = gT{xX')' or 

The common value of these two fractions must be a negative constant, say —X*, for otherwise T 
will not be a periodic function, as wc knovN it must be Hence, 

T « A cos \ y/ ’<, I + P Bin 

and 

(2) ,xX'y + X*A’ = 0 

Using (kirollary I of Theorem 1, Sec 9 4, the solution for A' is found at once to be 
X = rVo(2X \/t) f DYoC2\\^t) 

Since the displacement of the free end of the cable will obviously be finite, 
whcrea.s >'o(2X \/ x) becomes infinite as x approaches zero, it is clear that D 
must be zeio Moreover, for all values of t, y is zero when x = I Hence 
X{1) =» 0, that 18 , 

(3) /.(2X Vh - 0 

This, of course, is the frequem \ equation of the system It has infinitely 
many roots, 

2X \// “ 2 4048, 5 5201, 8 0537, 

and so the natural frequencies of tin cable, namely, tij„ = X„ V g, are 
ai, = 1 2024 » 2 7600 y/g/t, « 4 3268 \/q/l, 

We have now been led to an infinite sequenee of product solutions, 

yjx.t) = = y„(2X„\/-c)M coh(X,„ \^gt) A- a m Sin (\„Vgt)\ 

None of these liy itself can satisfy the given initial conditions, namely, 

t/(-r,0) = 0 

dl ko ( 0 al <x <l 


1 



o 


nOURE 9.B 
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cable acted 
upon by a 
transverse force 
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Hence, as usual, we form an infinite senes of the individual product solutions, 


(4) y(x,i) ~ 2 7o(2X« \/x)[^„ cos (X„ \/g 0 + sin \/^ 0] 

m — 1 

and attempt to make it fit the initial conditions. 

Now Eq (2) with its accompanyiiiK boundary condition X{1) = 0 meets all the conditions 
of Theorem 4, Sec. 8 5 Hence, the A^'s arc orthogonal with respect to the weight function 
p{x) « 1 over the interval (0,/), and thus the A's and B’a can be determined by the familiar 
generalized Fourier pioceduie To find we put t =* 0 and y « 0 m (4), getting 

0“ ^ A,J^{2\^y/x) 

m “ 1 

from which it is obvious that 

A„ = 0 m - 1, 2, 3, . 

I 

To find B„ we differentiate ( 4) with respect to t and then put i = 0 and — = /(-r), getting 

dl |l*0 

(5) /(i) - £ 


Next, we multiply (4) bv yoCiXm "v/x) and integrate from Otof From the orthogonality of the 
Jo’s, every term on the right but one becomes zero, and we have 

\/t) (lx * jT ?'./o(2X,„ -y/x) di »= y/q\rr,B,n /o*(2X,„ y/x) dx 

?’ f /(,(2Xp, y/x) di 

or /fm * — j- - -- 

y/gXm I J o*(2X,n's/ x) dx 

To evaliiale these integrals wc make the oVjvious substitutions j- =* a’ and dx = 2ij du, 
f V 

r / uJo{2\nn)du 

getting B^ = --- 

\/g Xm [ uJoK2\^y) du 

The integral m the numerator is precisely 

iiJj(2X„.u)lvf^ „ VJ y/(tl) 

2X„, |o “ 2X„ 

Because of the condition (3), the value of the integral in the denominator is, as we showed in the 
proof of Theorem 1, Sec 9 6, 

V^) 

2 ~ 


Hence, finally, 


l' /"a i/i(2Xw, ) 

\( 7 ' J,\2K„y/l) 


With Am and Bm determined for all values of m, the solution is now complete 

It is interesting to note that, since the X's are incommensurable, there are no two times 
when the terms sin y/g \„t are respectively the same Hence the cable never returns to a posi¬ 
tion coinciding exactly wuth an earlier one unless it is vibrating in one of its normal modes, that 
ifii unless all but one of the Bm’s are zero, which cannot happen for the given f{x) This is m 
lll|up contrast to the behavior of the stnng stretched under umform tension, wdiich repeats any 
configuration exactly after intervals of 2l/a, where a is the propagation velocity for the string. 
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A metal fin of triangular cross section is attached to a plane surface to help carry off heat from 
the latter. Assuming dimensions and coordinates as shown in Fig 9 9, find the steady-state 
temperature distribution along the fin if the wall temperature is and if the fin cools freely 
into air of constant temperature uo 



A portion of a 
triangular cool¬ 
ing fin attached 
to a fiat wall 




jA,r 

^ X \ 


We shall base our analysis upon a unit length of the fin and shall assume that the fin is so 
thin that tiMiipcraturc variations parallel to the base can be neglected Now, consider <hc heat 
balance in the element of the fin between j and j Aj: This element gams heat by internal flow 
through its right face and loses heat by internal flow through its lell face and also by cooling 
through its upp and lower surfaces Through the right fan* the gain of heat per unit time is 

Area X thermal conductivity X temperature gradient 


bx\ ^ 1 r 1 

a/ L “ 

Through the left face the ('lenient loses heat at the rate 

r bkx dal 

[~V dxjx 


Through the surfaces evposed to the air the element loses heat at the rate 

Area X surface ('onduciivity X (surface temperature — air temperature) 


or 2(1 ) h(tj - Uo) “ --7'" “ 

\ cos 6/ cos 9 

Under steady-state conditions the rate of gain of heat must equal the rate of loss, and thus 
we have 

C bkx da~] r bkx di/T 2h(u — Uq) Aa: 


Writing this i 


bkx da 1 bkx du 

a dj-Jr+^T a dx t 


\x{du/dx)]x^ixr — [i{du/dx)\x 


(u — Uo) 


and letting Aj- 0, we obtain the differential equation 


(u — Mo) 


If we set 
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thifl becomes 


- a>C/ - 0 


This can be solved immediately by means of the corollary of Theorem 1, Sec 9.4, and we have 
U — w — no — ci/o(2a y/x) + c%K(^2a “v/x) 

Since fiCo(2o y/x) is infinite when x - 0, cj must be zero, leaving 
U — Uo “ Ci/o(2or y/~x) 

Furthermore, u ^ when x — a, hence, 

T ” “0 

Uw — no " Ci/o(2a "v o) "-7—” 


7,(2a\/o) 


Therefore, 


n — no + (n«, — no) 


/o(2a \/x) 
/o(2a a) 


A solid consists of one-half of a right circular cylinder of radius 6 and height h (Fig 9 10) The 
lower base, the curved surface, and the vertical plane face are maintained at the constant tem¬ 
perature n ■" 0 Over the upper base the temperature is a known function of position f(r,d). 
Assuming steady-state conditions, find the temperature at any point in the solid 

Because of the nature of the boundaries of the solid it will be highly inconvenient to use the 
heat equation in the cartesian form in which we derived it m Sec 8 2 Instead, we use it as 
expressed in cylindrical coordinates by means of the change of variables 


namely. 


dhi I du 1 dhb d^u 
dr* r dr r* dO* ^ dz* 


or, more specifically, for steady-state conditions, under which — =» 0, 

dt 

1 dn 1 d^u d*u 

(6) — -H--f-H--0 

dr* r dr T* dd* dz* 

Our first step is to assume a product solution u(r,a,z) = Ii(r)0(d)Z(z) and substitute it 
into (6) in an attempt to separate the variables This gives 

R^'QZ ~ R'^Z “ 1 — R^"Z -|- R^Z" “ 0 


FIGURE 9.10 
A half cylinder 
in which heat 
flow occurs be¬ 
cause of surface 
temperature 
conditions. 
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or, multiplying by r* and dividing by ReZ, 


r>R" R' 
R '^"‘r 



e 


" Ml 


where the common value mi is necessarily a constant, since the variables appearing on the respec¬ 
tive sides of the equation are independent of each other 

If Ml < 0, say Ml " - »**, then — - v* and 

(7) 0 ™ A cosh uB -i- B sinh vB 

Now, by hypothesis, 

u{r,(],z) = R{r)B{0)Z{z) ■« 0 and — R(r)^ir)Z(z) " 0 

and these can hold for all values of r and z only if 0(0) — 0(ir) - 0 f’rom (7) we see that the 
condition 0(0) “0 will Vie satisfied only if A — 0 To satisfy the condition 0(ir) - 0, it is 
necessary that 

li sinh VTT = 0 

which, since v ^ 0, is possible only if B “ 0 Thus, the possibility mi < 0 leads only to a trivial 
solution and, hence, must be rejected. 

If Ml “ 0, then 0" “* 0 and 

0 = A + 


Again imposing the conditions 0(0) =» 0(ir) =» 0, we find, as befo'-e, that A — J? « 0 Hence, 
the possibility mi ” 0 must also be rejected,'since it leads only to a trivial solution 
Finally, if m >0, say mi ** *'*; have 

0 '/ 

— =« _ and 0 “ A cos yB B sin yB 

0 

For this to vanish when ^ 0, we must have A “ 0 For it to vanish when ® ™ ir. it is necessary 

that 

B sm rx “ 0 

Since we cannot permit B to be zero, because that would lead again to a trivial solution, we 
must have 

sin vir “ 0 

Hence y => 1, 2, 3, 

and so for 0 we have the family of solutions 
0„(^) - sin nS 

With Ml now known to be n’, the differential equation for R and Z becomes 


or, rearranging, 


R" R' . Z" 

T + T 


Z 


EL 

~R 


E 

R 


n* 


Mt 


where, again, since r and z are independent variables, it follows that the common value m 2 must 
be a constant. 

If Mt < 0, say M» * — we have 


EL ^ E 

ft r ■ 



0 


or 


r*R" + rR' - (XV« + n*)fl - 0 
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which is precisely the modified Bessel equation. Hence, 

R - CInM + DKn{\r) 

Now Kni^r) 18 infinite when r » 0, hence, to keep the temperature finite on the axis of the 
cylinder, it is necessary that D - 0 Also, by hypothesis, 

u{b,e,t) “ R(h)e{e)Z{z) - o 

Hence, R{b) m Clni'^b) — 0 

But the modified Bessel function In is never zero except possibly at the origin Therefore, the 
last condition can hold only if C =• 0. But with C and D both zero, the solution is trivial, and 
so the possibility that mi < 0 must be rejected. 

If MS “ 0» then 

- 0 or r*R" + rR' - n'R ~ 0 

R r R r« 

This is not a Bessel-type equation, but is instead an example of the Ruler equation (Example 3, 
Sec. 2.6) By the usual change of independent variable 

r “ e" or i; — In r 

it becomes -— n*/c — 0 

or* 

so that R “ Cc’*” + = Tr" -f- Dr~'^ 

To keep the temperature finite on the axis, where r «= 0, it is necessarv that 7) « 0 To keep the 
temperature zero when r ■= 6, it is necessary that 

0 » 

which will be the case only if T — 0 This means that again the solution is trivial, and mz “ 0 
must also be rejected 

Finally, if ms > 0, say ms “ X*, we have 

^ ^ 4- X* — ~ 0 or r^R” -|- rR' -|- (XV* — n^)R - 0 

R r R r* 

and R — r'J„(Xr) -j- DY„{'Kr) 

Since Fn(Xr) is infinite when r »= 0, we must have 7) =• 0 To keep the temperature zero on the 
curved surface of the cylinder we must have 

R{b) m CJ^iU) - 0 

Since C — 0 leads to a trivial solution, it is thus necessary that 
JnW - 0 

that IS, X is restricted to the set of values 

Pnm 

~b 

where pnm is the with one of the roots of the equation /^(r) * 0 Thus, for every value of n, 
there are infinitely many particular solutions for R, namely, 

72nm(r) " t/n(Xnwir) 

Now that we know that mi “ Xj^, it is an easy matter to solve for Z, and we have 
Z^' 

and Z ^ E cosh \nmZ -I- F sinh X„,nZ 

Zi 
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Since M(r,(9,0) be ff(r)O(d)Z(0) -» 0, it follows that ^(0) — 0, from which we conclude that 
^ - 0 The solution for Z associated with is, therefore, 

“* Hinh Xnrn2 

For each n we therefore have mfinitel/ many product solutions consisting of the same factor 
0(0) * sin n6 multiplied by the product of any pair of corresponding Fi’a and Z*s 

Unm " AnmJniKmr) Slllh \nmZ 810 11$ 

In other words, we have a double array of product solutions, 

Wn, tin, Vn, , 

'U2\, W 22 , W 24 , , W2fn, 

Uni, Un2, Unt, • , Wnm, 

Since none of the product solutions by itwif is ^apabU of reprciienting the given temperature 

distribution f(r,6) on the upper base, it is necessary th.tt v\( conatiuct an infinite senes of the 
Wnw’s and try to make it fit the temperature jondition when z = h To build up a series for u 
we first add up all the product solutions associated with a particular value of n, getting 

« 00 

Un llnm. “ Sin flB -4 ntn«^n( SlTlll Xnm^ 

m ■= 1 m ‘T 1 

This, of course, amounts to forming the sums of the elements m each of the rows in the above 
array Next, we add up all these series for every value of n 

OQ OQ 0 

(8) n(T,e,z) = S I sin n0 ^ AnmJniKmT) siuh \nmZ 

n*-l n“l m = l 

The final step now is to dotorinine the so that this double series will reduce lo f(r,6) when 
z h 

(9) f(r,6) ’= ^ I Bin n0 V ,4nm/n(X„„,r) sinh X„,„/? 

T ,-1 ^ m-l 

To carry out this expansion, let us imagine that r is lield constant and that 6 is allowed to 
vary over the range of the problem (0 ,t) Under these conditions the inner sum in (9) is effec¬ 
tively a constant depending on n, say On, or more explicitly Gnir) That is, 

f(r,6) «= ^ fzn sin r ?0 

n “ 1 , 

But the determination of the G’b is a familiar problem! In fact it is nothing but the Fourier 
8ine-expansion problem, and we ran write iinniediately 

(10) = (z„(r) - - f f{r,e) Bin ne de 

w JO 

Thus Gn{r) 18 a known function of r But, by definition, (7„(r) was the inner sum in (9), that is, 

r) " (-dfini sinh hnmh')tTn(,'hnm^') 

TO — 1 

Hence, it is clear that the A's must be such that the products Anm Binh \nmh are the coefficients 
m a Bessel function expansion of the now known function G„(r) Hence, from the theory of the 
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last section, recalling that the X’s were determined by the condition 


we can write 


Therefore, 


Jn{\b) - 0 


■A^nm Binh \timb 


rOn(r)Jn(Kmr) dr 

r<7.(r)y.(X nm r) dr 
(6V2) sinh Kmh 


where Gn(r) is given by (10) With the coefficients in the series solution (8) now determined, the 
problem is solved 


1 What i8£{«Jo(XO)? 

2 What 18 £|7a(X0)? Hint Recall from Eq (3), Sec 9 5, that 

J,(M) - 7o(Xt) - 2 
a Whatis£|J„(X«)|? 

4 Show that jT Jo(Xf) dt ■= - [Hint Consider the integral defining the Laplace transform 
of Jo(Xf).l 

0 What IS (t) J^{U) dl? (b) jT* dl? (c) L/,(x0 di? 


6 What IS £-1 


7 What is 


+ 4s 4- 13) ' 


(« + a) \/s> -f bi 


Show that £ l/o(XO | 


\/«* - x» 


9 What is (t)£U7o(M)|? (b) £ {«/,(x0) ? 10 What is £ |7,(X0) ? 


11 What is £-* 


- — ■ ? 

\/«(« - 1) 


12 Show that 


13 Show^ that I 


jT /o(X)/o(/ — X) dX <= sin t (Hint Recall the convolution theorem ) 

hit) — — / r- — dX (Hint Combine Formula 4, Sec 7 3, for the 

TT 70 -/ x(t. — \\ 


’T 70 \/x(i - X) 

case n — — with Theorem fi, Sec 7 4, and then apply the convolution theorem to the 
result of Exercise 8 ) 

14 Find the solution of the equation y” 4- y ™ Joit) for which 7/0 = t/I, — 0 Hence show that 
t/,(o - /; Bin (< — X)do(X) dX [Hint- Solve the equation by Laplace transform methods 
using Eq (1) and also the convolution theorem ) 

16 What IB sin (t — X)d,(X) dX? 

16 Derive Formula (1) by expressing as an infinite senes and taking the Laplace 

transform term by term 

17 Show that £ {do(2 VO) - ^ «"*'• What is £-> [c-*'* - I) ? 

18 Using Laplace transform methods, as illustrated in Example 1, show that a complete solu¬ 
tion in terms of elementary functions can be obtained for the equation 

(at -b b)y" 4- (ct -h d)y' -b (et + /)y » 0 
t^if od — fic ■» 2o*A: and cj — be ^ ck, where Ar is a negative integer. 
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19 Show that the function 0(z) = d0 satisfies the difTerential jquation 

ii>' — z<ff =‘ 0 

Hence show that tft(z) is of tlie form CKo(z) 

20 In Example 3, verify that all the heat that enters the fin is lost from its surface What frac¬ 
tion of the heat entennK the fin is lost from the section between j *« 0 and x - a/2? 

21 Work Example 3 (i:iven that the fin is of rectanRular cross section 

22 Show that the radial temperature distribution in a thin fin of rectangular cross ocction and 
outer radius Fi which completely encircles a heated cylinder of radius r satisfie the differ¬ 
ential equation 



where x is measured radially outward from the ^entcruf the cylinder and the other param¬ 
eters have tht‘ same significance as in Example 3 

23 Solve the differential equation of Exerci.se 22, and find the Icmperature distribution in the 
fin if the eylindei leniperuture is Vr 

24 Work Exercise 22, given that the hn is of tnangnlnr cross section 

25 Find the first two natural frequcucK's of a steel shaft 20 in long vibrating toraionally if the 
shaft IS built-iii at one end and free at tin* other and if tin* radius of the shaft at a distance x 
from the free end is ; (r) = (r/20i'' Sleid weighs 0 2sr) Ih/in \ and its modulus of elasticity 
m shear is E, = 12 X Ih/m * 

26 An clastic string who.se weight pci unit length is i/'o(l orj), where x is the distance from 
one end of the . <iiig, is stretched undei tension T ludween two jioints a distance I apart 
Find the equation defining the natural frequencies of the string 

27 A body whose mass varu's according tc> the law 7n((} = »io(l -f at) '■ incjves along the j-axr 
iindcT the influence of a force- of at traction w liw li \:iiic*s direc tlv as (he distance from the 
origin ncUerniuie the* eciuation ol nuOion of the bo<l\ if il .starts from rest at the point 
r = xq 

28 Work Exercise 27 if the force is directed aw n\ from the origin 

29 The lower end of a long thin rod of uniform eio.ss .sen lion is c lamjied so that the rod is 

vertical Determine the values of the parainc'tc'is of (lie rod for winch buckling will occur 

if the upper end of the rod is displaced slighth from its neiitnil po^ihon [Hint Dhoosing 

axes as in Example 1, Sec 2 fi, the problem can be solved by using the rchit ion (Ely")' =« V, 
wdiere V is the transverse component of the w^eighi of the portion of tlie rod al»ov e a general 
point X, or by u.sing the relation {Ely")" = — ic, wliere w is the transverse component 
of the weight per unit length of the rod at the point i ] 

30 A cantilever beam of length / and breadth h has its upper surfare hori/ontal The depth 

of the beam vanes directly as the cube root of the distance from the free end An oblique 

tensile force F, whose direction makes an angle 6 w'lth the horizontal, acts at the free end 
of the beam Find the equation of the deflection curve of the beam 

81 Work Exercise 30 if the force is an oblique compressive force 

32 A cantilever lieam of length / and breadth b has its upper surface lionzontal The depth 

of the beam vanes diroetlv as the two-lhird.s power of the distance from the free end If 

the beam bears a uniform load of iv lb per unit length and is acted upon by a pure tensile 
force F at its free end, find the equation of the deflection curve of the beam 

33 A bar has the shape of a truncated right circular cone of length /, the radii of its bases being 
r and H Find the frequency equation for the torsional vibrations of the bar, assuming both 
ends of the bar free 

34 Determine the limiting form of the frequency equation in Exercise 33 when rIt Check 
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by comparing your result with the frequency equation derived directly for a uniform bar 
(Hint: Express the Bessel functions in terms of smes and cosines ) 

86 Determine the natural frequencies of a uniform circular drumhead 

86 Find the frequency equation for the transverse vibrations of a cantilever whose width is 
constant but whose depth varies directly as the distance from the free end (Hint. To solve 
the differential equation defining the normal modes of the beam, recall P^xercise 8, Sec 9 4 ) 

87 Find the frequency equation for the transverse vibrations of a cantilever beam which is a 
solid of revolution whose radius varies directly as the distance from the free end 

88 Work Example 4 if the curved surface of the solid is perfectly insulated. 

80 The lower base and curved surface of a right circular cylinder of radius b and height h are 
maintained at the constant temperature ■= 0 Over the upper base the temperature is a 
known function of position f{r,6) Assuming steady-state conditions, find the temperature 
at any point m the cylinder 

40 A thin circular plate has its upper and lower faces insulated against the flow of heat One 
half of its circumference is maintained at the constant temperature 100'’, the other half is 
maintained at the constant temperature 0® Find the Fteady-statc temperature distribution 
in the plate 

41 The region between two concentric circles of radii ri and r; is initially at a uniform tempera¬ 
ture of zero At f — 0 the temperature around the entire inner boundary ih suddenly rawed 
to 100® Find the temperature at any point in the region at any subsequent time if the 
outer boundary is maintained at the temperature zero 

42 A right circular cylinder of radius h and height h has its upper and lower bases maintained 
at the temperature 0® The curved surface of the cylinder is maintained at the temperature 
distribution u{b,z) /(z) Determine the steady-state temperature distribution throughout 
the cylinder 

48 A right circular cylinder of radius b and height h has its lower base maintained at the con¬ 
stant temperature 0® Over its upper base the temperature distribution uiT,h) ■” fir) is 
maintained If the curved surface cools fieely into uir of constant temperature 0®, find tin* 
steady-state temperature distribution within the cylinder 

44 A two-dimensional region having the shape of a quarter of a circle is initially at a uniform 
temperature of 100® At ^ 0 the temperature around the entire boundary is suddenly 

reduced to zero and maintained thereafter at that value Find the temperature at any 
point of the region at any subsequent tunc 

46 Find the steady-state temperature distribution in a two-dimensional region having the 
shape of a quarter of a circle if the curved boundary and one of the radial boundaries is 
maintained at the constant temperature 0® and the other radial boundary is maintained 
at the constant temperature 100®. 


9.8 


Legendre polynomials 

In Example 4, Sec 9.7, in solving the steady-state heat equation, 
1 e , Laplace’s equation, in cylindrical coordinates, we found that 
one of the ordinary differential equations arising from the separa¬ 
tion oi variables was Bessers equation. In very much the same 
way, it turns out that, when we apply the method of separation of 
variables to Laplace’s equation in spherical coordinates, one of 
the ordinary differential equations which results is Legendre^s 
eqiMtion. 
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If the expression 
dx^ ^ dy^ ^ d2* 

IS transformed from cartesian coordinates to spherical coordinates 
by means of the relations (Fig 9 11) 


FIGURE 9 ] ] 

Plot showing 
the relation be¬ 
tween rectan¬ 
gular and 
spherical 
coordinates 



j = r sill 6 cos <l> ?/ = r sin 0 sin 0 z — r cos 6 

vp obtain, after a lengthy but straightforward reduction, 


V-'F = 


_ 1 

sin d 




dF 




sin H- 2r sm 6 ~~ + sin B + cos 


.dF 


1 d^F 


. . F\ 

de *" sirTe a 07 


(1) 


dr ' ae^ 

Hence, when Laplace’s equation V'^F = 0 is expressed in spherical 
coordinates, it becomes 

r2 sin 6 — -h 2r sin B - + sin 0 - -|- cos B -- — = 0 

dr^ dr dB^ dB sin B d0^ 

Any solution F{r,B,<l>) of this equation is known as a spherical 
harmonic. 

In an attempt to solve Eq (1), we assume a product solution 
F(r,e,4>) = R{7)G(e,4>) 

Then, substituting this into (1), we have 

dF 7? d^F 

sin B R"a -h 2r sin 6 R'G -f sm 0 ~ L cos B R-^ + —- ^ ^ 

dB^ dB sm 6 d<f)^ 


or, dividing through by RG sin B and rearranging, 


rm"_± 2rW ^ , J 

R \G de^~ G 


cos B dG 


+ 


d'^G\ 


( 2 ) 

( 3 ) 


' sm BdB G sm’^ B d^y 

This relation can hold only if the common value of these two 
expressions is a constant For later convenience we write the 
constant as n{n -b 1); hence, we are led to the two equations 
r^R" d- 2rR' - n(n + l)ii! = 0 


d^G . COB 6 dG ■ 

W Sn“0 dd sin* e d0* 


+ n{n + 1)6 


0 
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(4) 

(5) 


(6) 


The first of these equations is an instance of Euler^s equation 
(Example 3, Sec 2 6), and it is easy to verify that its complete 
solution is 

^ 

Solutions G(0,4>) of the second equation, which we will have to 
find by a further separation of variables, are known as surface 
harmonics. 

If, in (3), we substitute = 0(0)<1>(0), we find 

e»$ + ® e'«i> + + 1)®* = 0 

sm 6 sm^ S 

or, dividing by 04>/8in* $ and rearranging slightly, 

0" 0' 4»" 

sin* 0— -h sin ^ cos ^ — + n(n -h 1) sin* 0 = - — 

0 0 T 

Again, the common value of the two members of this equation 
must be a constant, say m*, thus, we have the pair of equations 

-f rn*4> = 0 

sm* 0 0" -h sin 0 cos 0 0' -h [n(n +1) sin* 0 — m*]0 = 0 

The first of these equations is completely familiar,' and its complete 
solution 


<l> = C3 cos m<f> -j- Ci sin 


can be written down at once The second equation is known as the 
associated Legendre equation,'* although it is usually studied in 
the form obtained by setting x = cos 0 
If x = cos 6, then 


d0 dB dx . dB 

~T^ — -r -T7^ = — sin^-;- 
d0 dx d0 dx 



dx 


, d*0 dx 


- sin d , -ri 


dx* do 


dB , , ^ d*0 

— cos 0 -^—h sin* 0 -^2 

dJC dX 


Hence, substituting these expressions into (5), we obtain the 
equation 


sm* 0 ( 


/ ^ d0 , , ^ d*0\ , . ^ ^ d0\ 

(- ® ^Tx) 


-h [n(n -h 1) sin* 0 — m*]0 = 0 


or, dividing out sin* 0, substituting x = cos 0 m the coefficients, 
and simplifying, 


(1 - a-*) 


‘p,~2.f + \ 

dx* dx 


n(n -h 1) — 



* After the French mathematician Adrien-Marie Legendre (1752-1833). 
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This is the algebraic form of the associated Legendre equation. If 

m = 0, that IS, if the solution of the original problem is inde¬ 
pendent of the longitude angle 0, then Eq (6) reduces to 

(7) (1 — x^) ii(n -I- 1)0 = 0 

» 

which is known simply as Legendre’s equation. 

To solve Eq. (7) we use the method of Frobenius and assume 
a senes solution of the form 

0(x) = ^^(ao -h aix -h azX^ -|- -f Otz* H- ■ *) ao 0 

Then substituting into Eq (7), we have 


atc(p — !)**'■ + ai(c + J)ct‘ 


( 8 ) 


+ <i.(c + 2)(c + l)z- + 
— aoc(c — l)x' — 
— 2aacx* — 
+ n(n -f- Da**' -|- 


+ akMc + i + 2f(c + I + 1)*-+* + • 

- a*(c + t k - !)*«+* - 

- 2ak(c f fc)**”^* - 
f n(n + l)a**-+* -f • - 0 

For this to be an identity, it is necessary that 
aoc(c — 1) = 0 ai(c -f l)c 0 
and, in general, 

afc+ 2 (c 4- /r 4- 2)(c -f fc -f- 1) — a4(c + k)(c 4- fc 4- 1) — n(n 4- 1)] = 0 

If we take c — 0, both ao and Ci remain arbitrary, and we have for 
the general recurrence relation 


n*+2 — — 


^ - k)( n 4- /r 4- 1) 
(k 4“ 1)(A: 4" 2) 


a* 


/c = 0, 1, 2, 


Specifically, from (8), 


do — do 

n(n 4- 1) 
a. ==-2!— 


n(n — 2)(n 4- l)(n 4- 3) 
4! 


do 


di — dj 

(n - l)(n + 2) 
a, _ a: 

(n - l)(n - 3)(n + 2)(n + 4) 

06 = —--Ol 


Hence a complete solution of (7) can be written 

19) ew - [ 1 - + 3) _ , j 

, (« - l)(n - 3)(n + 2)(n + 4) J 

51 ^ J 

These infinite series define what are known as Legendre fimctions 
of the second kind. Since x = ± 1 are the only singular points of 
the differential equation (7), it follows from Theorem 1, Sec 9 1, 
that the radius of convergence of these series is 1. It can be shown, 
however, that neither senes converges at either of the end points 
X = ± I; that is, the interval of convergence for each series is 
-1 < X < 1. 
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( 10 ) 


In many applications the parameter n is a positive integer 
If it is odd, then, clearly, the Lsecond series in (9) contains only a 
finite number of terms, if it is even, then the first series contains 
only a finite number of terms In either of these cases the series 
which reduces to a finite sum is known as a Legendre polynomial 
or zonal harmonic of order n. To obtain a standard form for the 
Legendre polynomials it is customary to multiply the finite sums 
occurring in (9) when n is an integer by the appropriate one of the 
following factors 


/ l)n/2 ^ ^ ‘_( ^ ~ 

^ ^ 2 ■ 4 • n 





n even 




n odd 


This leads to the general formula 

(-l)‘(2n - 2*)! 

_ 2 " 

*-0 


P ^ y _( 

"ta:; 2, 2^kU7i - k 


'r!(n - kV{n - 2k)^ ' 


N = 
N = 


1 


n odd 


Specifically, we have 

Po(x) = 1 P,(x) = J 

P 2 {t) = - 1) P,(x) = - 3r) 

PiM - 30r2 -h 3) p,{x) -- 3^8(()3xf' - 70x^ d- l.L) 


As these particular results illust rate, Pnd) = laiidP„(—1) = (- 1)" 
for all values of n Since the inlinite series in (9) diveific 
when .T = ±1, it 18 clear that to ivithui an aihi(ia)y constant 
muUipher, Pn{x) is the only solution of Legend) e's equation whidi 
js finite on the closed inteival —1 ^ j- ^ 1 

One of the fundamental identities involving Legendre ]>o]y- 
nomials is Rodrigues’ formula :* 


THEOREM 1 






- 1 ) " 
dx^ 


PROOF This result can be proved by direct differentiation and induction, hut 
it IS perhaps more interesting to proceed in the following way If we let 

V = (x^ — 1)" 


then 


dv 

dx 


= 2nx{x^ — 1 )"“^ 


• Named for the French economist and mathematician Olindo Rodriguef^ 
(1794-1861). 
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or, multiplying the last equation by x* — 1, 

(** - 1) ^ = 271i(i2 - !)• 

and, finally, (1 ~ ^ + 2nxw = 0 

If we differentiate this repeatedly with respect to x, we obtain 
(1 — x'^)v^' -|- 2(n — l)xi;' -j- {2n)v = 0 
(1 - -b 2(n - 2)xi;" + 2(2n - l)i;' = 0 


and, after fc -f 1 differentiations, 

(1 - x2)i;^*+2> + 2(71 - A: - (k l)(27i - ky’^^ = 0 

If we now take k = n and put = u, the last equation becomes 
(1 — x'^)u" — 2x\i -f n(n -f \)u = 0 


which IS precisely Legendre’s equation But 


u — = 


d”(l — x^)'" 
dx" 


IS obviously a polynomial of degree n. Moreover, from (9) it is clear that to within 
a constant fac r there is only one polynomial solution of Legendre’s equation, 
namely, Pn{x) Hence, P„(x) must be some multiple of u, that is, 


Pn{x) 



Finally, wc can determine c by equating the coefficients of x" in the two member^ 
of the last identity Clearly, the coefficient of x” on the right-hand side is 

(-])" c(2n)(27i - 1) • I2n - (n - 1)1 = (-1)" “r c 


Moreover, setting = 0 m Eq (10), we sec that the coefficient of x" in P„{x) is 

(2n)! 

2"(n!)> 


Hence, we must have 
(2n)l 


-SfiLi: — r —iv 
2 "(n!)2 ^ ^ 


(2n)! 


or 


(- 1 )" 


n! 2"n! 

which completes the verification of Rodrigues’ formula 


Another important identity involving Legendre polynomials 
is embodied in the following theorem 


theorem 2 

- ,- .J_. = Po(*) + P.(x)x + P,(x)x« + • • ■ 

Vl - 2xx + z'i 


+ P.(x)z'‘ + 
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P R O O f To prove this, we expand the radical on the left-hand side by the 
binomial theorem, getting 


[1 - z(,2x - *)]-W = 1+5 2(2x - «) + ^ ^•( 2 x - zy + 


1 -3 


(2n - 3) 


1 3 


2"-Hn - 1)! 
(2/1 - 1) 


2 "n! 


z”~^(2x — 2)”~^ 
z"(2x — 2)" + ■ 


Now 2 ” can occur only in the terms out to and including the one containing 
z^(2x — 2 )", and from these, by expanding the various powers of (2x — 2 ), wc 
find that its total coefficient is 


1.3- (2n-l)^2x)"-' " 


• (2n - 3) n - 1 


2 "n! 

-h 


1 • 3 


- 2 ) 


2"-Hn - 1)! 

(2n - 5) (n - 2)(n - 3) 

-2^1 ■ 2! 


11 


(2x)’‘- 


or, multiplying and dividing by the factors needed to complete the factorials in 
the numerators, 

(2n)! _ ( 2n-2)l _ _(2n - 4)! _ . 

2"n'n! 2»-+f(n - l)'(n - 2)' ^ 2"-*2'(n - 2)'(n - 4)' 

which 18 precisely the expanded form of Pnix), as given by (10) Thus 


(1 — 2 x 2 + 2 ^) = X asserted. 

n —O 

In other words, the expression (1 — 2 x 2 + 2 ^)“^^ is a generating function for the 

X / 1\ 

Legendre polynomials, analogous to the generating function exp 2 \~ j) 
the Bessel functions which we investigated in Sei*,. 9 5 


In many applications the algebraic form of the Legendre 
polynomials is the more useful. There are problems, however, 
m which it IS essential that they be expressed in terms of 6, the 
colatitude angle of the spherical coordinate system with which 
our discussion began. This can easily be done by reversing the 
transformation x = cos Q which led from the trigonometric to 
the algebraic form of Legendre's equation However, replacing 
X by cos 0 in P„(x) leads to expressions whuth are quite incon¬ 
venient because of the powers of cos Q they contain Fortunately, 
using the generating function provided by Theorem 2, we can 
easily derive more useful forms in which cosines of multiples of 6 
take the place of powers of cos B. 

To do this, let us substitute 


X 


cos B = 


gitf _|_ g- 
2 


into the generating function, getting 

[1 - 2 (e‘» + €-'•) + = ((1 - ze'*)(l - ze ->')]-^‘ = P.z" 

n-1 
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1 3 
2 4 


( 11 ) 


Now, if we use the binomial theorem to expand each of the factors 
m the middle term of this continued identity, we obtain 


(1 - = 1 -j- _ _|_ 


2-4*® 


(2« - 1) 


and 

(1 - = 1 + A ze-‘» + -V-7 + 

2 2'4 




2-4 ■ * (2n) 

13 
2 • 4 
1 • 3 




(2n - 1) ... 

^4—(27ir ■ 

The coelhcient of 2 " in the product of these two senes is easy to 
determine, and we find for it tlie expression 


(2n 


1 ) 


(2n) 


(pn.fl 


.) +1 Li 

’ 2 2 4 




1_3 1 

2 4 2 4 


(2ri - J) 
(2n -- r>) 


(2r? - -4) 


(,,(n 


_j_ ^-(n- A)i9^ ^ 


flericc, replacing the various conibiiiatioiis of exponentials by 
tlieir cosine equivalents and recalling that the coefficient of z" in 
the expansion of the generating function is just P„, we have finally 


P„(cos d) = 


1 ,3_ 


2 

■f ^ ' 

• «» r» 


4 
2 

2 4 


(2n) 


2 cos n6 


3 

4 

]_ 

T 4 


(2^- 3) 
(2n - 2) 


2 cos (n — 2)6 


i2n - 5) 

-- 2 cos (n 

(2n — 4) 


4)6 + 


If 71 IS odd, the final term in P„(cos 6) contains the factor cos 6 
and IS correctly given by the last nonzeio term 111 the series (11) 
However, if n is even, the final term in f*„(cos 6) is a constant 
which IS equal to just half the last nonzero term in the senes (11). 
This IS the case because, although the general term m the coeffi¬ 
cient of 2 " contains both and e when n is even 

and k = n/2 these terms are identical and arise only once in the 
product of the senes for (1 — and (1 — and not 

twice. Thus, specifically, 

Po(cos 0) = 1 
Pi (cos 6) = cos 6 


P2(cos 6 ) 


3 COR 26 + 1 
4 


Pa(cos 6) 
Pi{c 08 6) 
PsCcos 6 ) 


5 cos 3^ + 3 cos 6 

8 

35 cos 46 + 20 cos 20 -|- 9 
64 

63 cos 50 4- 35 cos 30 + 30 cob 0 
128 




BtSSEL FUNCTIONS AND LEOENOtE POLYNOMIALS 


CNAP. f 


Since Legendre’s equation can be written in the form 

^Kl-^M + n(n + l), = 0 

it is clear that it is a special case, with 

= 1 q{x) = 0 t{x) = 1 — X® X = n(n -h 1) 

of the equation covered by Theorem 4, Sec 8 5. Hence, if solu¬ 
tions of Legendre’s equation satisfy suitable boundary condi¬ 
tions, they must be orthogonal In particular, for the important 
interval ( — 1,1) no boundary conditions are necessary, since 
r(x) = 1 — X® vanishes at each end point; that is, 


/!i P^MPnix) dx = 0 m ^ n 


Before the property of orthogonality can be used to expand 
an arbitrary function m terms of Legendre polynomials, we must, 
of course, know the value of the integral of the square of the 
general Legendre polynomial. This can be obtained in various 
ways, but perhaps the simplest is to use the generating function 
provided by Theorem 2 If we square the identity 


Pq(x) + Piix)z + 


+ P„(x)3" + 


(1 - 2X2 + 2®)^ ~ ^ ^ ^ 

and integrate with respect to x from —1 to 1, we obtain 

l~i r - - F7« “ /-I 

The integral on the left is easily evaluated On the right, all 
integrals involving the product of two different P's are zero 
because of the orthogonality property (12) Hence, 

- ^ In (1 - 2 x 2 + 2 ») |*_^ = Po’(x) dx 

+ 2* Pl*(x) dx+ ■ + 2 »" P.»(x) dx + 

Evaluation of the left member leads at once to 

- [In (1 - 2 )* - In (1 + 2 )»] = i [In (1 + 2 ) - In (1 - 2 )] 

Moreover, if we replace the logarithms by their respective power 
senes, we obtain 


1 / _ 2* 2> 2®- 2®"+‘ \ 

2V* 2 3 2n 2n + 1 ' ') 

_ I / ^ z» ^ z®" \ 

2 y 2 3 2n 2n "HI J 

( 2 ® 2 * 2 ®" \ 

l+3 + 5+ - +^+- -) 
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Hence, comparing coefficients of 2 *" in this series and in the right 
member of (13), we obtain the desired result- 

(14) /_\ P,Hx) dx = 2 ;^ 

By means of the substitution x = cos 0, Eqs (12) and (13) 
can be transformed at once into corresponding results for the 
Legendre polynomials m trigonometric form. Hence, we can state 
the following important theorem* 


THEOREM 3 

The Legendre polynomials in algebraic form satisfy the orthogonality relations 

0 m n 

2 

o' “r 1 

2n H- 1 

Ju tiigonometric form, the Legendre polynomials satisfy the orthogonality relations 

( 0 7n ^ n 

2 

'2ir+i " 


1'^ P„(x)P„(x) dx = 


K 


EXAMPLE 1 

The known temperature distribution v = /(<?) is maintained over the entire surface of a spliere 
of radius b Find the steady-state ternpcratuie at any point in the spheie 

Here we have to soive the steady-state heat equation, 1 c , Laplace's equation, in spherical 
coordinates How-cver, from the ob/ious circular symmetry of the problem it is clear tliiit v is 

a function of r and 6 only Hence —= 0, and Eq. (1) reduces to 


(15) 


d^U dv <lhi dll 

r® Hin 8 - + 2? sin 6 -1- sm 6 - + cos 6 — =0 

(9r* dr 36^ 36 


Assuming a product solution 

u “ /i?(r)0(0) 

and substituting into (15), we obtain 

r* sm 6 R"i^ -f- 2r sm 6 7^0 + sin 6 RiV 4- cos 6 R^' 
From this, by dividing by am 6 RB and transposing, we have 


2tR' 

R R 


B" 


cos 0 0' 
sm 6 0 


Since for any v, the quadratic equation n* T n — = 0 is always satisfied bv at least one 

(possibly complex) value of n, it is no specialization to lake y “ n(n + 1), so that we have the 
two ordinary differential equations 

r^R" + 2 tR' - n(n -h I)/? - 0 
sm 6 0" -h cos 0' -b n(n -f 1) sm 0 0 — 0 

The first of these is just an instance of Euler’s equation, and its general solution is easily 
found to be 


- Ar" + — 

»n + I 
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However, since we require solutions which arc finite when r “ 0, it is clear that we must spe¬ 
cialize this by taking ^ — 0 The scrond equation is Legendre’s equation. Since we require 
solutions of It which are finite over the closed interval 0 ^ ^ ^ ir and since the only such solu¬ 
tions are the Legendre polynomials P„(cos 0), it is clear that n must be an integer and 

0 — Pfi(co8 B) 

Hence, we have the infinite sequence of product solutions 

>lirPi(co8 $) i42r>p2(co8 d) . A„r''Pn(coB 0) 

None of these by itself can satisfy the given temperature condition 
n(b,B) -/(<?) 

on the surface of the sphere Hence, as usual, we form an infinite senes of the individual product 
solutions and attempt to make it fit the boundary condition Thus we write 

(16) “ 5) ^nr^Pnicoa 0) 

n — 1 

Then, substituting r » 6 and u(b,6) « /(tf), we get 


/(<>)" 51 ^nh'^Pnicoa 6) 


To find we multiply the last equation by sin P„(cos 0) and integrate from 0 to ir By virtue 
of the orthogonality properties of the P’s, all integrals on the right except one become zero, and 
we have 

fw 2 

/ f{0) sin 0 P,(co8 0) d0 “ - 

JO 2n -1- 1 

. 2n + 1 /-r ^ ^ ^ 


h 1 

— I f(0) sin 0 P»(co8 0) do 
" JO 


With the coefficients in the senes (16) known, the problem is now formally solved 
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a minimum Show that P(x) is the nth partial sum of the expansion of f(x) over the interval 
(-1,1) in terms of Legendre polynomials. (The Legendre polynomials thus play the same 
role in the least-square approximation of continuous functions that the orthogonal poly¬ 
nomials discussed in Sec 4 6 play m the least-square approximation of tabular functions ) 
4 Show that the Legendre piolynomials with even subscripts and the Legendre polynomials 
with odd subscripts both form orthogonal sets over the interval (0,1) 

6 By differentiating the generatmg function for the Legendre polynomials, show that all 
derivatives of even order of Pnix) vanish at i ■■ 0 if n is odd, and that all derivatives of odd 
order vanish at x ■« 0 if nis even What are the values of the nonsero derivatives at x “ 07 
0 Using Rodrigues’ formula, prove that 

Pn^Ax) - P:_,(x) - (2n + l)P.(x) 

Hence show that 


i: 


Pnix) dx 


Pn-Ax) - PnMx) 
2n -h 1 


7 Find the steady-state temperature at any point in a spherical shell of inner radius 6j and 
outer radius bj if the temperature distributions u(bi,0) —/i((?) and u(6j,0) */i(8) are 
maintained over the mner and outer surfaces, respectively. 

8 The temperature distribution u(b,S) ’“fid) is mamtamed over the curved surface of a 
hemisphere of radius 6 The plane boundary of the hemisphere is kept at the temperature 
u “ 0 Find the steady-state temperature at any point in the hemisphere. (Hint: The 
results of Exercise 4 may be of assistance ) 

9 Find polynomial solutions of the equation 

y" — 2xy -f 2ny = 0 n an integer 

and show that tli. y arc orthogonal with respect to the weight function e"** over the interval 
(— oo,oo) [This equation is known as Hermite's equation, after the French mathema¬ 
tician Charles Hermite (1822-1901), and its polynomial solutions are knowm as Hermite 
polynomials.] 

10 Find polynomial solutions of the equation 

xy" + (1 — x)\/ -f- ny = 0 n an integer 

and show that they are orthogonal with respect to the weight function e"* over the interval 
(0, oo) [This equation is known as Laguerre’s equation, after the French mathematician 
Edmond I..aguerre (1834-1886), and its polynomial solutions are known as Laguerre 
polynomials.] 




CHAPTER TEN 


Determinants 

and 

Matrices 


10.1 


□•tarminontt 


In a restricted sense, at least, the concept of a determinant is 
already familiar from elementary algebra, where, in solving sys¬ 
tems of two and three simultaneous linear equations, we found 
it convenient to introduce what we called determinants of the 
second and third order. In the work of this book we shall have 
occasion to generalize these ideas to the solution of systems of 
more than three linear equation^ and to other applications not 
imniediately associated with solving equations For this reason 
we shall devote this and the following chapter to a leview and an 
extension of our earlier study of determinants and to a discussion 
of some of the fundamental properties of the related mathematical 
objects known as matrices 

By a determinant of order n we mean a certain function of 
n* quantities, which we shall describe more precisely as soon as we 
have introduced the necessary notation and preliminary defini¬ 
tions. The customary symbol for a determinant consists of a 
square array of the n* quantities enclosed between vertical bars 




ail 

ai2 

ai„ 

( 1 ) 

11 

II 

021 

022 

a2n 



a„i 

an2 

a„n 


For brevity, we shall often use the word determinant to refer to 
this symbol as well as to the expansion^ for which it stands. 


t The use of vertical bars in the notation for a determinant and in the nota¬ 
tion for the absolute value of a Quantity, while perhaps unfortunate, is 
universal. Which meaning is intonaed in any particular case should always 
be clear from the context. 

X See Definition 1, this section, p. 403. 
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Although logically undesirable, this dual usage is quite common 
and should cause no confusion 

The quantities which appear in (1) are called the elements 
of the determinant The horizontal lines of elements are called 
rows; the vertical lines of elements are called columns. In the 
convement double subscript notation illustrated in (1), the first 
subscript associated with an element identifies the row and the 
second subscript identifies the column in which the element lies. 
There is, of course, no reason to suppose that the element in the 
tth row and jth column is the same as the element in the^'th row 
and ith column, and so in general o.^ ^ aj^ The sloping line of 
elements extending from an to a„n is called the principal diagonal 
of the determinant. 

The determinant |A/| formed by the elements common to 
any m rows and any m columns of an nth-order determinant |A| 
IS said to be an rnth-order minor of \A\. The determinant of 
order n — m formed by the elements which remain when the m 
rows and m columns containing an mth-order minor \M\ are 
deleted from \A\ is called the complementary minor of \M\. If 
the numbers of the rows and columns of \A | which contain an 
mth-order minor t^/| are, respectively, 

• ■ I'^m and JijJii • )jm 

then ( —tunes the complementary minor 
of \M\ IS called the algebraic complement of |A/| The first-order 
minors of \A\ are, of course, just the elements of \A\ Their 
complementary minors are customarily referred to simply as 
minors, and their algebraic complements are almost universally 
referred to as cofactors. We shall denote the minor of the element 
a^j by the symbol Mtj and its cofactor by the symbol thus, 

A,, = 

Similarly, we shall use the symbols Mij,ki and A^j^ki to denote, 
respectively, the complementary minor and the algebraic com¬ 
plement of the second-order minor contained in the ith and jth 
rows and the fcth and Zth columns of a determinant |A|, thus, 

The generalization of this notation is obvious. 

EXAMPLE I 

In the fifth-order determinant 


Oil 

On 

Oil 

014 

Oil 

On 

On 

Oil 

034 

Oat 

Oil 

On 

Oil 

014 

Oil 

Oil 

041 

041 

044 

046 

On 

Ou 

Oil 

0.4 

Obi 
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the minor of the element an is the fourth-order determinant formed by the elements which 
remain when the fourth row and third column are deleted from |i4l, namely, 

Oil On oi4 att 
Oji fljj aj4 024 

Mil - 

Oil aj2 aj4 oji 
Ofi 062 Ob4 066 

The cofactor An of the element an is equal to this minor times ( —1 )*■*■*, i c., 

An —Mn 

Similarly, the complementary minor of the second-order rumor 

Osi Oi« 

051 054 

contained in the third and fifth rows and the first and fourth columns of |-4| is the third-order 
determinant formed by the elements which remain when these rows and columns are deleted 
from \A\ 

Oi2 On Oib 

Mn.u = OJZ 023 026 

O 42 043 O 46 

The algebraic complement A 35.14 of the given second-order minor is equal to the complementary 
minor times ( - i e , 

■d| 6 .i 4 “ —3/35,14 

For a second-order determinant we have the definition 

Cl 1 1 CL \ 2 _ 

— 011^22 ~ 

(l2l (I 22 

tiiat IS, a second-order determinant is equal to the difference be¬ 
tween the product of the elemenis on the principal diagonal and 
tlie product of the elements on tlie other diagonal For a third- 
order deterimnnnt \ve have the dehuilion 

dll ai2 du 

d2l d22 ^21 ~ ^llfl22fll3J “l~ ^12^2.1^* 11 Cl\\Cl2\^\2 

^31 ^32 <2^3 — di.id22^,n — dild23tl32 ~ (ll2CL2lCliA 

This expansion can also be obtained by diagonal multiplication, 
by repeating on the right the fust two columns of the determinant 
and then adding the signed products of the elements on the various 
diagonals in the resulting array 




(-T 



The diagonal method of writing out a determinant is correct only 
for determinants of the second and third orders, however, and will 
in general give incorrect results if applied to determinants of 
higher order. 
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We are now in a position to give the general definition of a 
determinant. This can be done in direct fashion, but the result is 
unsuited to the practical evaluation of determinants; hence, we 
choose to give an inductive definition: 

definition 1 

The determinant 

On ai2 flin 

fl21 ^22 0'2n 

dnl dni Ofifi 

IS equal to the sum of the products of the elements of any row or column and their 
respective cofactors; i.e , 

1^1 = X "" X 

)-i .-1 

Clearly, this definition makes a determinant of order n depend 
upon n determinants of order n — 1, each of which in turn 
depends upon n — 1 determinants of order n — 2, and so on, 
until finally the expansion involves only second- or third-order 
determinants which can be written out by the diagonal method. 
However, before Definition 1 can be accepted and used, it must be 
sh wn that the same expansion is obtained no matter which row or 
which column is selected That this is the case is guaranteed by 
the following theorem 



THEOREM 1 

If the elements of any row or of any column of a determinant are multiplied by 
their respective cofactors and then added, the sum is the same for all rows and for 
all columns 

PROOF We shall first prove that the same expansion is obtained no matter 
which row is chosen To do this we proceed inductively Clearly, the theorem is 
true when n = 2; for, expanding the determinant 

Oil ai2 

fl21 

in terms of the elements of the first row and their cofactors, we get 
^11(022) “b ai2( —a2i) 

and, expanding in terms of the elements of the second row and their cofactors we get 

a2i( — 012 ) + a22(aii) 

and these two expressions are identical. Let us assume, then, that the assertion of 
the theorem is true for determinants of order n — 1, and let us attempt to prove 
that it IS true for determinants of order n. Specifically, let us expand the nth-order 
determinant 


1^1 - K| 
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in terms of each of two arbitrary rows, say the ith and the jth, and compare the 
expansions. In doing this it is, of course, no specialization to assume t < j. 


(4a) 


(46) 



k < I 


k > I 


Now, a typical term in the expansion of |i41 according to the elements of the 
tth row is 


(6) aai4,fc = 

and this contains the only occurrences of a,* in the entire expansion. Moreover, the 
(j — l)st row of M^jt contains n — 1 elements from the jth row of 1^4(, and Mtk can 
legitimately be expanded m terms of these elements, since the hypothesis of our 
induction is that the theorem in question is true for determinants of order n — 1. 
As the typical term in the expansion of according to the elements from the jth 
row of IA I, we therefore have 

(6) an ■ (cofactor of in M,*) I ^ k 

and this contains the only occurrences of in the expansion of Mtk. Hence, sub¬ 
stituting the expression (6) into Eq. (5), we find that the expression 

t7) (“ • [a,i • (cofactor of in Mtk)] I ^ k 
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contains the only occurrences of the product in the expansion of |i4| in terms 
of the elements of the ith row. In exactly the same way, if we first expand \A\ in 
terms of the elements of the jth row and then expand the minor Mji in terms of the 
n — I elements from the ith row of j^l which it contains, we conclude that the 
only occurrences of the product a^kdji in the expansion of [A | in terms of the ele¬ 
ments of the jth row are contained in the expression 

(8) { — ■ [a.* ■ (cofactor of in Mji)] k ^ I 

If we can show that (7) and (8) are identical, we will have completed our proof 
that under the induction hypothesis all row expansions of |A| are the same, since 
a,fca,< {k 9 ^ 1) IS the typical product of an clement from the ?th row and an element 
from the^th row, and each term m the expansion of \A \ according to the tth row 
or the jth row must contain one and only one such product. 

Now, except for the proper power of ( — 1), both the cofactor of Gji in M** 
and the cofactor of a** in Mji are equal to the determinant of order n — 2, say 
formed by the elements which remain when the zth and jth rows and the 
A-th and /th columns are deleted from \A\. There are two possibilities to consider, 
ac(ording as fc < i (4a) or k > I (4b), i e , according as the kth column precedes 
or follows the Zth column in the determinant \A\ Taking due account of the 
relative positions of the deleted rows and columns, the proper signs are easily 
determined by inspection, however, and we have, respectively, in the two cases. 

Cofactor of a,i m M.* - (-1)<^- 
ejfactor of Gik in Mji = ( — 

Cofactor of a^i in M^k = (— 1 ^ ^ 

Cofactor of a^k in Mji = ( —) 

Finally, substituting these expressions into (7) and (8), we find that the coeffi¬ 
cient of the product as determined by either method of expansion, is 

(9o) { — k < I 

(96) iM,,,ki - k > I 

In exactly the same way, if we expand |A| in terms of two arbitrary columns, 
say the fcth and the Ith, we find that the coefficient of the general product Uikaji 
IS still given by (9a) and (96) This proves that, under the induction hypothesis, 
not only are all column expansions of |i4| equal but their common value is the 
common value of the row expansions of |i4| Thus we have completed our proof 
that if the theorem is true for determinants of order n — 1, then it is true for 
determinants of order n Since we have already proved it true for row expansions 
of second-order determinants and could similarly prove it true for column expan¬ 
sions, our induction is complete; Theorem 1 is established; and Definition 1 is 
unambiguous. 

Since the same expression is obtained whether we expand a 
determinant m terms of the elements of an arbitrary row or an 
arbitrary column, we have the following obvious consequence 
of Theorem 1; 


k < I 
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THEOREM 2 

If \A \ is any determinant and if |B| is the determinant whose rows are the columns 
of |A1, then \A\ = |B|. 

The proof of Theorem 1 also provides us with the proof of 
the following important result. 


THEOREM 3 

Let any two rows (or columns) be selected from a determinant |A|. Then |A| is 
equal to the sum of the products of all the second-order minors contained in 
the chosen pair of rows (or columns) each multiplied by its algebraic complement 


PROOF Let the chosen rows be the pth and the gth, and, for definiteness, 
suppose that p < q. Now a typical second-order minor from these rows is 


( 10 ) 





and to prove the assertion of the theorem it is sufficient to show that the coeffi 
cient of this binomial in the expansion of \A\ is 


Ap^.r, = 


To do this, we observe first that, from Eq. (9a), with i p, j = k = r, and 
I = 8, the coefficient of the product apra^, m the expansion of |A| is 




Also, taking t = Py j = q^ k — 8^ and I = r m Eq. (96), we find that the coefficient 
of ap,a^r in the expansion of |A| is 

Hence, the expansion of 1A| contains the terms 

and these are the only occurrences of the products Opra,, and a^.a^r. Finally, from 
these, by factoring, we obtain 

(aprUgi apfa9r)[( ~ i.O'prO'qg O'ptdqr) A pq 

which completes the proof of the theorem in the case where two rows are used for 
the expansion An essentially identical argument establishes the assertion of the 
theorem when two columns are used. 


By a somewhat more involved argument the following gen¬ 
eralization of Theorem 3 can l>e established 


THEOREM 4 

Let any m rows (or columns) be selected from a determinant |A|. Then \A\ is 
equal to the sum of the products of all the mth-order minors contained in the 
chosen rows (or columns) each multiplied by its algebraic complement. 

Both the general result Contained m Theorem 4 and the special 
case m — 2 contained m Theorem 3 are usually referred to as 

Laplace’s expansion. 
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EXAMPLE 2 

Expand the determinant 


1^1 - 


V 


f ' 


For purpoBos of illustration we shall obtain the value of this determinant using Definition 1 
and also using Theorem 3 According to Definition 1, using the third row because of the presence 
of the zero element, we have 



2 

3 4 


1 

3 4 


1 

2 4 


1 1 

2 3 

(0) 

3 

2 1 

- (-1) 

4 

2 1 

4(2) 

4 

3 1 

- (3) 

4 

3 2 


6 

4 - 2 


1 

4 -2 


1 

6 -2 


1 

6 4 

or, expanding the third-order determinants by the diagonal methfid, 






lAl = 1 

f) 4- 75 -1- 

180 

- 105 - 

150 






Equivalently, applying Theorem 3 in terms of the first two 

rows, we have 



1^1-1; 

2 

1 1 2 3 

1 - h ^ 

l|- 

• 1 3 1 


Ml 

-1 2 1 




t 3 

1 1 4 -2 

1 14 2 

11 

6 -21 


6 4 1 









2 3 1 1 0 

3 1 


2 4||0 - 

M + 

; 4 1 

|0 -1 1 






3 2 1 ! 1 

-2 1 


3 i| h ■ 


! ] 1 

1 1 el 


-5)( 

-16) - ( 

-!())( -16) 4 

(-15)(- 

16) +( 

- 

6)(-3) - ( 

-10)(- 

-2) +(-5)(l) 


- 150 


as before 

Using Thooronis 1 and 3, a number of other theorems ean 
easily be proved In particular, we have the following useful 
results* 


THEOREM 5 

If all the elements in any row or in any column of a determinant are zero, the 
value of the determinant is zero 

PROOF If we expand the given determinant, aci^ording t^o Definition 1, in 
terms of the row or column of zero elements, each term in the expansion contains 
a zero factor Hence, the entire expansion is zero, as a.sserted 

THEOREM 6 

If each element in one row or in one column of a determinant is multiplied by c, 
the determinant is multiplied by c 

PROOF If we expand the given determinant in terms of the row or column 
whose elements have been multiplied by c, each term in the expan.sion contains 
c as a factor If c is then factored from the expansion, the result is just c times the 
expansion of the original determinant, as asserted. 

theorem 7 

If |A| IB any determinant and if |/i| is the determinant obtained from \A\ by 
interchanging any two rows or any two columns of |i41, then |fi| = — 1A|. 
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PROOF Let |-A| be any determinant, and let |B| be the determinant obtained 
from \A\ by interchanging any two rows (or any two columns) of |^|. Now, 
clearly, if the rows (or the columns) of any second-order determinant are inter¬ 
changed, the resulting determinant is the negative of the original one. Hence, 
if |B| IS expanded in terms of the two rows (or columns) which were interchanged, 
it follows that each second-order minor occurring as a factor of a term m this 
expansion is the negative of the corresponding second-order minor from the 
corresponding pair of rows (or columns) in |^| Therefore, each term in the 
expansion of |B| is the negative of the corresponding term in the expansion of 
|A| based on the same two rows (or columns). Thus |fi| = —1^|, as asserted 

THEOREM 8 

If corresponding elements of two rows or of two columns of a determinant are 
proportional, the value of the determinant is zero 

PROOF Clearly, any determinant of the second order whose rows or columns 
are proportional is zero. Hence if we expand the given determinant, according to 
Theorem 3, m terms of the two rows or two columns which are proportional, it 
follows that each term contains as one factor a second-order minor ecjual to zero 
Therefore, the entire expansion is zero, as asserted 

THEOREM 9 

If the elements in one column of a determinant are expressed as binoitnal.s, the 
determinant can be written as the .sum of two determinants, according to the 
formula 


Oln 
din 

dnn 

A similar result holds for a determinant containing a row of elements which are 
binomials. 

PROOF If we expand the given determinant, according to Definition 1, in 
terms of the column which contains the binomial elements, we obtain 

n n n 

2 (a., -h a»j)A„ = Y, + 2 

t-i 1-1 1-1 

Since the sums on the nght are, respectively, the expansions for the determi¬ 
nants appearing on the nght side of the formula in the theorem, the theorem is 
established. 

THEOREM 10 

The value of a determinant is unchanged if the elements of any row (or column) 
are modified by adding to them the same multiple of the corresponding elements 
m *ny other row (or column) 


On 

<llj -f Oflj 

ain 

021 

dtj -h 

d2n 

Ofil 

dfij “H 0(nj 

djin 


Oil 

Oij 


‘ Oln 


021 

02j 


02n 


0,11 

Onj 


Onn 




Oil 




-h 

021 

CC2j 



Oa 1 


Otnj 
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PROOF If we apply Theorem 9 to the determinant resulting from the given 
row (or column) modification, we obtain two determinants, one of which is the 
original determinant and the other of which contains two proportional rows (or 
columns') By Theorem 8, the second determinant is equal to zero, and the 
theorem is established. 

Theorem 10 is very useful in the practical expansion of de¬ 
terminants, for, by its repeated application, one can reduce to 
zero a number of the elements in a chosen row (or column) of 
the given determinant Then, when the determinant is expanded 
in terms of this row (or column) most of the products involved 
will be zero and the computation will be appreciably shortened. 


EXAMPLE 3 

Find the value of the determinant 

31-121 
0 3 14 2 

1 4 2 3 1 

5-1-3 2 5 

-11232 

Here, in an attempt to introduce as many zeros as possible into some row, let us add the 
third column to the second and to the fifth, and let us aild twee the third column to the fourth 
ftnd 3 times the third column to the first This Rives the new but equal determinant 

I 0 0-1 0 0 

13 4 16 3 

7 6 2 7 3 

-4 -4 -3 -4 2 

5 3 2 7 4 


ExpandinR this in terms of the first row, accordinR to Definition 1, we have 

I 3 4 6 3| 



1 5 3 7 4| 

Now, adding twice the last column to each of the first three, we obtain the equal determinant 


9 

10 

12 

3 

13 

12 

13 

3 

0 

0 

0 

2 

13 

11 

15 

4 


or, expanding in terms of the third row, 


-(2)(-l)»+^ 


10 

12 

12 

13 

11 

15 

row 

or i 


order, we can expand it by the diagonal method The result is —166. 


THEOREM 11 

The sum of the products formed by multiplying the elements of one row (or 
column) of a determinant by the cofactors of the corresponding elements of 
another row (or column) is zero. 
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PROOF Let |A| = |a,,| be the given determinant, and let the elements of 
some row of |i4|, say the fth, be multiplied by the cofactors of the corresponding 
elements in some other row, say the jth, giving the sum 

5) o^kAjk 

Clearly, according to Definition 1, this can be thought of as the expansion of a 
determinant whose yth row consists of the elements 

CLxl CLi 2 ' CLtn 

and whose other rows are identical with the corresponding rows in |i4| In this 
new determinant the ith and jih rows are therefore the same, and, hence, by 
Theorem 8, the determinant is equal to zero A similar argument leads to the 
same conclusion if the elements in some column of \A\ are multiplied by the 
cofactors of the corresponding elements in some other column of \A | Thus the 
theorem is established 

Combining Definition 1 and Theorem 11, we have the follow¬ 
ing useful result. 

COROLLARY 1 

If Aij 18 the cofactor of the element in the determinant \A\ 

2 a,kAjk = { i?i ^ y-nd ^ a^kAa 

*.i \\A\ i = j .ri 

EXAMPLE 4 

If we take the elements of the first row of the determinant 

On Ois Oil 
Oil Ojj Oil 
Oil OiJ Oil 

and multiply them by the cofactors of the, correspondiriK elements in the third row', say, we 
obtain the sum 

Oil Oil On On On fin 

On — On On 

Ost Osa I 0 x 1 0 x 1 I Oxi 0 x 2 

and this is clearly the expansion of the determinant 

On On Oil 
0 x 1 0 x 2 O 21 

On On On 

aocordiDK to the third row Since this determinant has two identical rows, it vanishes identically 

Results such as those of Corollary 1 are often stated more 
compactly in terms of what is known as the Kronecker delta/ 
usually written 6,j, or sometimes 5/, and defined to be 0 or 1 
according as t j or i ^ j. Using the Kronecker delta, the 


= |a„|, then 

^ I 0 k^l 

1 |A| = / 


Named for the German mathematician I.«opold Kronecker (1823-1891). 
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assertions of Corollary 1 can be written m the simpler form 

n 

(11) 5) OrtA,* = |A|i„ 

n 

( 12 ) 5 ) 


theorem 12 

I'he product of two determinants of the same order is a determinant of the same 
order in which the element in the ?th row and ^th column is the sum of the prod¬ 
ucts of corresponding elements in the zth row of the first determinant and the 7th 
'“olumn of the second determinant 


PROOF For simplicity we shall prove this theorem only for determinants of 
the second order, although for these direct verification is easier and more natural 
than the method we shall actually use. The virtue of our proof is that it can be 
extended immediately to the general case of determinants of any order We begin 
by observing that if 

|A1 = 

then, by Theorem 3, 


dll 012 0 0 

O2I d22 0 0 

Cii C12 bii 612 
C2I C22 ^21 f>22 

where Cu, ri2, C21, and ^22 are completely arbitrary. In particular, it is convenient 
to take Cii = C22 = —1 and C12 = C21 = 0, so that we have 


1A| |J5| = 


dll di2 


611 612 

d2l d22 


621 ^22 


Oil O12 
021 022 


and 1^1 = 


bii bi 2 

621 622 


|A| |B| 


Oil fli2 0 0 

O21 O22 0 0 

— 1 0 bii bi 2 

0 — 1 ^21 ^22 


Now if we multiply the elements of the first column by bn and the elements of 
the second column by 621 and then add them to the corresponding elements of 
the third column, we obtain, by Theorem 10, the equal determinant 


dll 

0.12 dllhll 

"h 012621 

0 

d21 

O22 d 2 l 5 ll 

H- 022621 

0 

-1 

0 

0 

612 

0 

-1 

0 

622 


In the same way, if we multiply the elements of the first column by 612 and the 
elements of the second column by 622 and then add them to the corresponding 
elements of the fourth column, we obtain from the last determinant the equal 
determinant 


Oil di2 dii6ii -f O12621 

011612 + 012622 

O21 022 021611 O22621 

O21612 ~h O22622 

-10 0 

0 

0-1 0 

0 


|yll 1^1 = 


4\1 


DffTEftMlNANTS AND MATRiCiS 


CHAP. 10 


If we now expand this determinant by Theorem 3, applied to the last two rows 
we obtain ' 


lAl. |5| 


Oubii “h ai2&si 

021^11 ”f O 22 & 2 I 


which is the result asserted by the theorem. 


nil&12 + 012^22 
fl21^>l2 “1“ O22&22 


EXERCISES 

1 Find the value of each of the following determinanlB 


1 

2 

3 

4 

b 

1 

2 

3 

4 

c 

0 

1 

2 

3 

2 

1 

4 

3 


4 

3 

2 

1 


-1 

0 

1 

2 

3 

4 

2 

1 


2 

1 

4 

3 


-2 

-1 

0 

3 

4 

3 

1 

2 


3 

4 

1 

2 


-3 

-2 

-3 

0 


2 a Find the value(s) of a, if any, for which the diagonal method of expansion yields llu* 
correct value for the determinant 


12 3 4 

-12 0 3 

2 0 r 1 

1 4 —9 a 


b Show' vhat there is no value of a for which the diagonal method of PX])an»ior yn-klF the 
correct value for the determinant 

12 11 
-113 2 

-13 9 1 

2 11a 

3 Show that the numoer of terms in tlie expansion of h general determinant of order n is 

4 If I 1 ( “< |a,,l IS a determinant of order n with the property that a,, = a,» for all values of / 
and j such that ] < i,j < n, prove that |-4j =» (— 1)“ j.4| What further roiiclusion can b( 
drawn if n is odd^ (Hint Use Theorems 2 and G ) 

5 Prove that 


1 

j 1 -f Ui 

aa 

Oa 

On 


1 Oj 

1 -h 02 

Oa 

On 


ai 

02 1 

4- Oj 

On 


ai 

02 

a. 

1 d" Of, 

nth-oidcr determinant 




1 4 

X 

0 

0 


X 

1 4 

X 

U 


0 

X 1 

4x» 

0 


0 

0 

0 

- 1 4- X* 


0 

0 

0 

X 


1 T «i -}- aa + fla "h 


0 

0 

0 


-h 


+ 


show that — (1 d- Using this relation, determine the value of D\o if 

I “ 1; if jr - — 1 la the value of independent of 
7 If Dn IB the nth-order determinant in which each element on the principal diagonal is a, 
^ch element immediately above the principal diagonal is 6, each element immediately 



SIC 10.1 


DETERMINANTS 


413 


below the principal diagonal is c, and all othex clementB are eero, obtain a recurrence rela¬ 
tion expresfling D„ in teims of D„_i and D«_j Use this relation to infer the value of D„ if 
0 ““ 3, b — 2, c ” 1 

8 Show that the nth-order determinant 


ah- h h 

ha - - h h 

h b -ah 

h h -ha 

IB equal to (a — b)""‘la + (n — l)b] 
9 Shovi that 


1 

1 

1 

1 

Ol 

02 

Oa 

a4 

Ol* 

02 * 

O3® 

oA 

Ol' 

O2* 

Os* 

0/ 


ai){c. 


aj)(ui — — a»)(o 2 — a i)(aj — 04 ) 


What IS the generalization of this resull to (letornunants of order n? 

10 If pi, , pn are polynomialb and if xi, x-j, , in are variables, show that the nth- 

order determinant 



Pi(Xi) 

^ 1 ( 2 : 2 ) 

Pi(Xn) 


P2(jl) 

P2(22) 

P2(X,.) 


Pn(Xi) 

Pf>(X2) 

Pr(Xn) 

IB divisible by 

n 

(x, - Xj). 



1 <i<;<n 

11 Prove the following generalization of Theorem 12 The product of two determinants 01 the 
same order is another determinant of the same order m which the element m the ith row and 
jth column is the sum ol the products of corresponding elements in the ith row or column of 
the hrat deteimiriant and the jth row or column of the aecond determinant, a consistent 
choice of row' or column being maintained for all values of i and j (Hint Use Tlu^orem 2 ) 


12 a Show that \A \ 


b® -1- ac be c* 
ah ac he 
a* ah /)* + ac 


4aW 


^Hint Verify first that \A\ = 


b c 
a 0 
0 a 


0 

c 

h 


!') 


b 


Find the value of the determinant 


6* -f c" ah 
ah c* -h u’ 
ca be 


ca 

be 

o» + 6 * 


18 If Ii41 IS the nth-order determinant 


Oil 012 

011 022 

am 

am 

show that 

On 012 

021 O 22 

am Xi 

02b Xi 

Oiti On2 

Own 


Onl anl 

Vi yi 

Oun Xn 

I/b 0 


ij-i 


where A if is the cofactor of a„ in jA] 
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16 


16 


Show that the area of the triangle whose vertices are the points (xi,^i), {xt,yi) is 

given by the formula 

ii 




xi y\ 

xi Va 1 
Xi Vi 1 

where the plus or the minus sign is chosen according as the vertices of the triangle are 
numbered consecutively in the counterclockwise or the clockwise direction. 

If Pi (xi,i/i), Pa (xa,Va)i and P3 (xa,i/») are three points, no two of which lie on the same 
vertical line, show that the equation of the parabola of the family y *■ o + 61 + cx® which 


- 0 


Is this result correct if Pi, Pa, P| are collinear? 

Show that the equation of the circle which passes through the three points Pi (xi,yi)» 
Pa' (xi,y 9 ), and Pj (xa.ya) ean be written m the form 


Pu 

Pi. 

and P 3 

V 

1 

I 

1“ 

l/i 

1 

Xj 

Xi* 

Vi 

1 

Xj 

X2* 

Vi 

1 

Xi 

X3‘ 


I* 

v’ 

X 

V 

1 

Xi’ 

Vi’ 

Xl 

Vi 

1 

Xj* 

Vi* 

X, 

Vi 

1 

X,* 

vP 

X 3 

Vi 

1 


17 


- 0 


Is this result correct if the three points are collinear? 

a If /i oiix + a\%y an - 0 

U aaiJ 4- Oaay 4 O 23 “ 0 

U Oaix 4 oaiy 4 a»s *= 0 

are three lines no two of which are parallel, show that h, I 2 , and It are concurrent if and only if 



flu 

ail 

ail 

Ml - 

Oil 

Oil 

Ojj 


Osi 

asi 

033 


b Show that the area of the triangle determined by the lines h, /a, and U is equal to the 
absolute value of the expression 


A \iA uA 33 


Au 

Ajx 

A 31 


Ai2 Alt 
A7i A 2 B 
>4 31 ylss 


where A is the cofactor of o„ in \A\ 

18 If |v41 — la.jl, show that — A^j 

do,, 

19 If each element of a determinant \A 1 of order n is a differentiable function of <, show that 
the derivative of 1^4 1 with respect to / is equal to the sum of n determinants, the ith one of 
which is identical with 1 > 1 | except for the ith row which consists of the derivatives of the 
elements of the ith row of |i4| (Hint Proceed inductively, as in the proof of Theorem 1 ) 

20 If /), /s, , /« are suitably differentiable functions of t, show that 


/l 

/; 

/» 

/: 


/. 

/; 

■ 

/: 


• • 


/ii«-i) 

• /.<--« 

/i(.-i) . 

. . /,(-!) 


/i<"> • 

• • /.<-> 


Use the result of Exercise 10 .) 
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10.2 

Elementary properties of matrices 

Closely associated with determinants, yet significantly different 
and much more fundamental, are the mathematical objects 
known as matrices: 

DEFINITION 1 

An m X n or {m,n) matrix is a rectangular array of quantities arranged in m 
rows and n columns. 

When there is no possibility of confusion, matrices are often 
represented by single capital letters More commonly, however, 
they are represented by displaying some or all of the constituent 
quantities between double vertical bars,^ thus, 



Oil 

Ol2 

Oln 

11 

II 

021 

O 22 

fl2ri 


Oml 

Om2 

Omn 


Two matrices A — ||at,|| and B = ||6„|| are equal if and only if 
they are identical, that is, if and only if they contain the same 
number of rows and the same number of columns, and Ot; = b^j 
r all values of i and j 

A matrix consisting of a single column is called a colu mn 
matrix. A matrix consisting of a single row is cafled a row matrix! 
Both column m atrices and row matrices are often referred to as 
vectors. The matrix obtained from a given (m,7i) matrix 

A by interchanging its rows and columns is ca lled the transpose 
of^ 4 ^Wc shall denote the transpose of a matrix A by the symbol 
^ 4 ^, ^though some writers use the symbol or the symbol A. 
A matrix with the same n umber of rows and columns is called a 
square matri y. T he determinant whose array of elements is 
identicaTwith the array of elements of a square matrix is called the 
determinant of the matrix. A s(|uare matrix in which every 
clement below the principal diagonal is zero is said to be upper 
triangular. A square matrix m which every element above the 
principal diagonal is zero is said to be l<^er triaj)g;ulgr. A square 
matrix in which each element not on the principal diagonal is 
zero IS called a dia go nal matrix. Diagonal matrices are sometimes 
denoted by the symbol 

II 






Some writers use square brackets or parentheses instead of double bars. 
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A diagonal matrix in which each diagonal element is 1 is called a 
unit matrix. A unit matrix is usually denoted by the symbol /, 
or, more specifically, by the symbol 7 „ if it is a unit matrix of 
order n. A matrix m which every element is zero is called a 
null matrix or a zero matrix, and is denoted by the symbol 0 

If A IS an (m,n) matrix and if k and I are integers such that 
0 < k ^ m and 0 < I ^ n, then the array of elements common 
to any k rows and any / columns of A is called a (k,l) submatrix 
of A. If A IS a square matrix, any square submatrix of A v/hose 
principal diagonal is a part of the principal diagonal of A is called 
a principal submatrix of A A principal submatrix of a square 
matrix A is thus a submatrix of rows and columns with the same 
indices. The determinants of the square submatrices of any matrix 
A are called the minors of A. The determinant of any principal 
submatrix of a square matrix A is called a principal minor of A 

Most matrices which occur in elementary applications have 
the properly that all their elements are real. However, there are 
important applications, especially in mathematical physics and 
quantum mechanics, which involve matrices whose elements arc 
not real. For this reason we shall introduce certain definitions 
and later on state certain fundamental theorems in a form appro¬ 
priate to matrices whose elements may be general complex 
quantities 

Recalling that the conjugate of a complex number 2 — x -]r tij 
is the complex number z = x — ly, we say that the conjugate 
of a matrix A is the matrix A whose elements are, respectively, 
the conjugates of the elements of A. Clearly, a matrix is real, 
i.e., contains only real elements, if and only if A and A are the 
same matrix. Similarly, a matrix A is ijmagiiiary, i e , contains 
only elements which are pure imagmanes, if and only if A = —A 
The transpose of the conjugate of a matrix A is called the 
associate of A. 

A matrix equal to its transpose, i e , a square matrix such 
that a,j = a,I for 1 ^ ij ^ n, is said to be symmetric. A matrix 
equal to the negative of its transpose, i.e , a square matrix such 
that fly = — a,t and in which, therefore, a„ = 0, is said to be 
skew-symmetric. A matrix equal to its associate, i.e , a matrix A 
such that A = A^, is said to lie hermitian^'^ A matrix A such that 
A = — is said to be skew-hermitian. Clearly, a real symmetric 
matrix is just a hermitian matrit 'which is real, and a real skew- 
symmetric matrix is just a skew-hermitian matrix which is real. 
Thus, in particular, any result true for hermitian matrices is 
automatically true for real symmetric matrices For this reason, 
although real symmetric matrices are of fundamental importance 
m most of the applications of matrices in this book, we shall as 
far as possible state our theorems in terms of hermitian matrices. 


Named for the French mathematician Charles Hermite (1822-1905). 
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The concept of a matrix is essentially simpler than the con¬ 
cept of a determinant. For, whereas a matrix is just a collection 
of elements arranged in a particular way, a determinant is a 
rather complicated function of the elements in a given set In 
particular, -with every square matrix there is associated a deter¬ 
minant, namely, the determinant whose elements are respectively 
equal to the elements of the matrix. Thus determinants of order 
n and n X n matrices bear to each other the familiar relation 
of dependent and independent variable, respectively, and it is 
appropriate to speak of a determinant as a function o.' a square 
matrix. 

Examples of matrices can be found in many fields. For 
instance, if each of m students were given a battery of n different 
tests, the resulting scores would very probably be displayed in a 
table containing m rows—one for each student—and n columns— 
one for each test. The resulting array would, of course, be an (m,n) 
matrix m which the geneial element a,, was the score which the 
tth student made on the jth test. Matrices of this sort are of 
fundamental importance in the branch of mathematical psy¬ 
chology known factor analysi^i Similarly, if we had an electrical 
network containing n branches, we might, either experimentally 
or analytically, determine the current which would flow in the 
?th branch as a result of inserting a unit voltage m tho^th branch. 

tabular array of these quantities would also constitute a 
matrix—the so-called admittance matrix which is of fundamental 
importance in the theory of electrical circuits Still another 
example of a matrix is provided by an array of transition 
probabilities: Suppose that a system S can exist in any one of n 
states, say *Si, S2, , ^n, and that the probability of the 

system passing from the state Si to the state Sj by some well- 
defined random process is p,j Clearly, the p,/s can be displayed 
as an (n,n) matrix. Such matrices are of great importance in 
the theory of probability and its physical applications. 

Since, as we pointed out above, both row and column 
matrices are called vectors, we have, in effect, accepted the 
following definition ■ 

DEFINITION 2 

An 7i-dimensional vector is an ordered set of n quantities 

This use of the word vector requires explanation, since, at first 
glance, it appears to be somewhat at variance with the familiar 
usage of elementary physics In physics, a vector quantity is a 
quantity, such as a velocity or a force, which possesses both mag¬ 
nitude and direction and, hence, can be represented by a directed 
line segment. However, it is clear that such a quantity is uniquely 
determined by its components in the directions of the three 
coordinate axes, and conversely. Hence, it can be uniquely 
associated with an ordered set of three quantities, i.e., with either 
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a row matrix or a column matrix containing three elements. A 
vector quantity in the physical sense is thus an example of a 
vector in the matric sense. However, the matric sense includes 
vectors other than physical vectors. In particular, any set of 
values of xi, X2, ...» Xn which satisfies a system of n linear 
equations in n variables can be thought of as a vector, and in 
our work we shall often speak of the solution vectors of such 
systems 

By defining appropriately the addition and multiplication 
of matrices, an algebra of matrices can be developed As we 
shall soon see, this is quite different from ordinary algebra, and 
for this reason, it is convenient to have a term to denote col¬ 
lectively those quantities, such as the variables and constants of 
our work up to this point, which obey the familiar laws of 
elementary algebra. These we shall henceforth refer to as scalars. 
For matrices, in contrast to scalars, then, we have the following 
definitions and rules of operation. 

The sum or difference of two matrices A and B having the 
same number of rows and the same number of columns is the 
matnx A ± B whose elements are the sums or differences of the 
respective elements of A and B. Obviously, if addition is com¬ 
mutative for the elements of A and B, it is also commutative 
for A and B themselves, and we have A B = B A Simi¬ 
larly, if addition is associative for the elements of the matnees 
A, B, and C, it is associative for A, B, and C, and we have 
A -f- (B -f- C) = (A -h B) -h C Addition and subtraction are 
not defined for matrices which do not have the same number of 
rows and the same number of columns 

The product of a matrix A and a scalar k is the matrix 
kA = Ak whose elements are the elements of A each multiplied 
by k 

The scalar product of two vectors having the same number 
of elements, or components, is the sum of the products of cor¬ 
responding components of the two vectors The scalar product of 
two vectors X and Y is also referred to as the inner product or 
dot product of X and Y and is often denoted by the symbol X Y. 
Obviously, X Y = Y X. 

The coordinates of a point in three dimensions, say P. 
form a vector X = Hxi X2 Xall in the matric sense, which 
is completely equivalent to the directed line segment from the 
origin 0 to the point P, thought of as a vector in the physical 
or geometric sense. Now from analytic geometry we know that 
the square of the length of the segment OP is given by the formula 

(OP)* = Xi* -(- xa* 4- 


But this is simply the scalar product X X of the vector X with 
itself. Hence, by analogy, the leng^ or^absolute value of any 




SIC, 10.1 


ELEMENTARY PROPERTIES OF MATRICES 


419 


vector 

X = \\xi X2 * x„I| 

ifl defined to be the square root of the scalar product 
X X = I x.^ 

t- 1 

A vector X with the property that 

71 

X X = X *.’ = 1 
is called a unit vector. 

From analytic ii^eometry we also know that with every line I, 
there is associated a set of ordered triples 

{kli^kl^ykU) k 7^ 0 ; UM-k not all zero 

known as the dneciion numbers of the line Moreover, if (l\d2,U) 
and (mi,W2,wa) are, respectively, direction numbers of the lines 
/ and w, then I and m are parallel if and only if the sets (I1M2) 
and are proportional 8mce the sets diMn) and 

(mi,7712,m3) can obviously be thought of as vectors 

= 11^ U fall and Af = ||mi m2 mj| 

't is natural to extend these ideas to vectors in general by saying, 
as a matter of definition, that two nonzero vectors 

X = ||ii X2 x„|| and Y = \\y\y2 ' VnW 

have the same direction if and only if their components are 
proportional. 

It is also a well-known fact of analytic geometry that, if 
(lhh,h) and (W],m2,777.1) are, respectively, direction numbers of 
the lines / and m, then I and m are perpendicular if and only if 

/imi -j- 12^2 “h /3m3 = 0 

But this IS simply the condition that the scalar product L M of 
the two vectors L and I\f be equal to zenj. Hence, by analogy 
with this result, we agree that two nonzero vectors 

X = III, X2 r„|| and Y = ||v, yi ■ ■ j/„|l 

will be called perpendicular, or orthogonal, if and only if they 
satisfy the condition 

X ■ r = X = 0 

»-l 

This extended concept of orthogonality is of fundamental impor¬ 
tance in many applications of matrices 

Two matrices A and B are said to be conformable in the 
order AB if and only if the number of columns in A is equal to 
the number of rows m B. In other words, if A is an (m,n) matrix 
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and if B is a (p,g) matrix, A and B are conformable in the order 
AB if and only if n = p. With the idea of conformable matrices 
introduced, we are now in a position to define the important 
notion of the product of two matrices: 

DEFINITION 3 

If A is a ip,q) matrix and if B is a (g,r) matrix, so that A and B are conformable 
in the order AB, the product C = AB is the (p,r) matnx in which the element 
Cxj in the ith row and jth column is the scalar product of the zth row vector of A and 

Q 

the ^th column vector of B, i e , C = AB is the matrix for which c,; = ^ axkbk, 

k~i 

Multiplication is not defined for matrices that are not conformable 


EXAMPLE 1 



+ ( 

3)(-6) 

(2)(-2) -!-( 

3)(1) 

(2)(4) 4 ( 

3)(-3) 

(2)(7) -f ( 

3)(0) 

f(l)(5) -f (- 

l)(-6) 

(l)(-2) + ( 

-l)(l) 

(1)(4) + ( 

-l)(-3) 

(1)(7) + ( 

-1)(0) 

1 (0)(6) L ( 

4)(-6) 

(0)(-2) +( 

4)(1) 

(0)(4) + ( 

4)(-3) 

(0)(7) + ( 

4)(0) 

-8 -1 

-1 

14 






n -3 

7 

7 






-24 4 

-12 

0 







From Theorem 12, Sec. 10 1, and Definition 3, it is clear that 
the way in which we have defined the product of two matrices 
is preciselj'^ the way in which we proved that the product of two 
determinants can be formed. Hence, we have the following 
important result: 

THEOREM 1 

If A and B are square matrices of the same order, the determinant of the product 
AB is equal to the product of the determinant of A and the determinant of B 

For the multiplication of matrices we have the following 
important theorems: 

THEOREM 2 

For suitably conformable matrices, multiplication is associative, i e,, 

A(B(7) = (AB)C 

PROOF Let A be an (m,n) matrix, B an (n,p) matrix, and C a {p,q) matrix 
For convenience, let BC = D, AB = B, and let 

A(BC) = AD = F and (AB)C = EC = G 

Now the elementin the tth row and jth column of the matrix F = AD is, by 
Definition 3, 

n 

ft} = ^ O^ldkj 
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Moreover, since D = BC, we also have, by Definition 3, 

p 

dkj = ^ hkicij 

2-1 

Hence, substituting, 

n p n p 

(1) ^ ( Z Z S 

*-1 2-1 A - 12-1 

where the last step follows from the fact that a,* is independent of the index I 
of the inner summation and, hence, (‘an be moved across the inner summation sign 
Similarly, the element g,j in the ith row and jth column of the matrix G = EC 


p n 

= Z where = V a^kbkl 

2-1 *-i 

Hence, substituting, 

p n p n 

~ Z C Z ~ Z Z 

2-1 ib-l 2-1 ik-l 

Finally, interchanging the order of summation in the last double sum, we have 

(“) ~ Z Z ^’*^*^*^*^ 

*- 12-1 


From (1) uid (2) it is clear that = g^j for all values of i and j Hence, 
F = G\ 1 e,, 

A(BC) = (AB)C as asserted 

It IS interesting and helpful to note that the type symbol of 
the product of a senes of conformable matrices (‘an be obtained 
by “contracting” the type .symbols of the factors by canceling 
the common interior indices: 


EXAMPLE 1 


II fll’ 

2 II 

-'Il'i-I 

:i 4 


2 

5 

-11 

67 

li 

i via 

II 

3 11/ 1 

2 1 


4 


II « 

23 

11 

4 II 1 1 

2 1 

I II2 -l|l 1 

1" 26 II 


1 2 - 

■Ml-1 

22 

67 

'll 2 


Ml 3 II 1 

1 4 

9|! 


1 0 

3 II 1 

1 8 

23 


From the definition of conformable matrices, it is evident 
f that a matrix is conformable to itself if and only if it is square 
Hence, a matrix A can be multiplied by itself if and only if it is 
square In such a case the product A A is referred to as the square 
of A and is denoted by the symbol A^ Higher powers of A are 
defined in similar fashion. Theorem 2 guaranteeing that the 
definition 

A- = AA ■ ■ • A 


r fi,atorti 
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is unambiguous. With defined as the identity matrix /, It 18 
obvious that, for any nonnegative integers r and «, the familiar 
laws of exponents 

and {A^Y = A” 
hold for matric multiplication 


THEOREM 3 

For suitably conformable matrices, multiplication is distributive over addition; 
le., A{B + C) = AB + AC. 

Theorems 2 and 3 are “obvious”, that is, they assert prop¬ 
erties which we know to be true for products in elementary alge¬ 
bra and which, by analogy, we would expect to be true in matnr 
algebra. That these results must be proved and cannot be taken 
for granted is clear, however, from the next two theorems, which 
tell us that two other equally simple properties of ordinary 
algebraic multiplication do not hold for matric multiplication • 


THEOREM 4 

The product of two nonzero matrices may be a zero matnx, i e., the fact that 
AR ~ 0 does not imply that either A ~ 0 ox B — 0 . 

PROOF Clearly, to prove this theorem it is sufficient to exhibit two nonzero 
matrices whose product is a zero matrix, and we have, among infinitely many 
possibilities, 


6 4 2 


0 1 -2 


0 0 0 

9 6 3 


-10 3 

= 

0 0 0 

-3 -2 -1 


2-3 0 


0 0 0 


THEOREM 5 

Even for matrices which are conformable m either order, multiplication is not 
commutative; i.e., in general, AB 5^ BA 

PROOF To prove this theorem it is sufficient to exhibit two matnees A and B 
such that AB ^ BA, and we have, specifically, 


1 

2 


1 

1 


9 

3 

and 

1 1 


1 2 


4 

6 

3 

4 


4 

1 


19 

7 

4 1 


3 4 


7 

12 


In two special cases, however, the multiplication of matrices 
is commutative. Though these are simple .and obvious, they are 
of sufficient importance to be stated explicitly: 


THEOREM 6 

B^th unit niatrices and aero matnees commute with all suitably conformable 
matrices; more specifically, Ai - /A * A and AO OA 0. 

Since matric multiplication is not, in general, commutative, 
it is desirable to be id>le to describe concisely the order in which 
two ocmformable matrices are to be ipUltipUed. This we sl^l do 
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by adopting the following terminology In the product AB we 
shall say that A premultipliea or B is prexnultipUed by A, and 
B postmultiplies i 4 , or ^4 is postmultiplied by B. 


theorem 7 

The transpose of the product of two conformable matrices is equal to the product 
of the transposed matrices taken in the other order; i.e., (AB)'^ = B'^A’^ 

PROOF Let A he a. (p,q) matrix and let ^ be a {g,r) matrix Theii from the 
definition of the transpose of a matrix it follows that the element in ti e ith row 
and ;th column of (ABy is the element in the jih row and ith column of AB, 
namely, 

( 3 ) 2 

fc«l 

On the other hand, the ith row of B'^ is, by definition, the tth column of B \ i.e., 
the ?th row of consists of the elements 

hii, b2t) t 

Similarly, the jth column of A"^ is, by definition, the jth row of ^; i e , the ^'th 
column of consists of the elements 

• ) ^}Q 

Hence, the element in the ?th row and ^th column of is 

« Q 

J hkidjk = Y, 

A«1 

Since this is the same as the expression ( 3 ) for the corresponding element in the 
matrix {ABy, the theorem is established. 

COROLLARY 1 

The transpose of the product of any number of conformable matrices is the 
product of the transposed matrices taken in the other order, i e., 

(A,A 2 -Ar^y = AJ- A^^AJ V 

The definition of a matrix in no way rules out the possibility 
that the elements of a matrix are themselves matrices In fact, 
it is often convenient to subdivide, or partition, a matrix into 
submatrices and then regard the original matrix as a new matrix 
having these submatnees as elements In particular, it is fre¬ 
quently helpful to regard an (m,n) matrix A = ||a,;|| as a row 
matrix \\C\ C2 ’ whose elements are the respective 

column vectors of i 4 , or as a column matrix 

Ri 


II 

whose elements are the respective row vectors of A . 
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EXAMPLE 3 

For instaricc, among numerous other possibilities, we can write 


where A j i — 
or equally well A » I|A 

where now An 



an 

ai2 

an 

I On 








II 

Ai2 

A - 

a2i 

022 

a2i 

j 024 








II A 21 

A 22 


an 

Oi2 

ai3 

1 as4 



an 

aiz 

0\s 1 


A 1 

Ai2 =“ 

Aj, 

Ojl 

ai2 

a2i 1 



II ^24 II 



IWa. 


A IB A1 


an 

0x1 

Ai2 “ 

ai2 

0X2 

All “ 

a,j 

021 

Au » 

Ol4 

024 

Oi, 


0X2 


Oil 


034 


In constructing the product of two matrices it is sometiincs 
convenient to partition them before performing the multiplnfi- 
tion This can he done m many ways, but it is of course neccssai v 
that the given matrices be conformable and that the various 
submatrices which must be multiplied together also be con¬ 
formable. This requirement imposes no lesl-nction on the lion 
zontal partitioning of the first matrix or on the vertical paiti- 
tioning of the second matrix It does requiie, however, that the 
columns of the first matrix be partitioned into groups such thal 
the number of columns m each group is equal to the number of 
rows in the corresponding partition of the rows of the seen ml 
matrix Matrices for which this is the case are said to be con¬ 
formably partitioned. 

EXAMPLE 4 

By direct multiplication we have 


1 1 1 


1 2 3-1 


4 12 0 

2-1 0 


3-1 1 0 

= 

-1 r> 5 -2 

-1 0 2 


0 0-2 1 


-1 -2 -7 3 


On the other hand we can write, among various other posHibilities, 


1 1 

2 -1 

1 

0 

- 

A,2 II 

A 

and 

1 

3 

2 3-1 

-1 1 0 

-1 0 

2 

II ^ 21 

^22 II 


0 

0 -2 1 


and, from this point of view, the product of the two matrices is 


An 

A 12 

Bn 

^ AmBu 

-1- A \xBx^ 1 

A 21 

A 22 

B2^ 

A2ifin 

-|- A22Bx\ I 


or, performing the indicated multiplications and additions of the submatnccs, 


4 1 

4 

-1 

_L 

0 

0 

-2 

1 


4 

1 

2 0 

-1 5 

5 

-2 


0 

0 

0 

0 

- 

-1 

5 


-1 -2 

-3 

1 


0 

0 

-4 

2 


-1 

-2 

-7 


as Defore 
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Historically, the definition of the product of two matrices 
was introduced by the English mathematician Arthur Cayley 
( 1821 - 1895 ) as a result of his investigations on linear transforma¬ 
tions. By a linear transformation we mean a relation of the form 

y\ = CluXl -I- 0122:2 + ■ ■ • -h ainZn 

rn 2/2 = 021X1 -b 022X2 -j- • ■ + CLlnZn 

^ a 

Vn = On 1X1 + OnnXn 

connecting the variables {xi,X2, . . . ,Xn) and the variables 
(2 /i>2/2, ■ . . , 2 /n) in which the a^j are constants independent of 
(xi, . . ,Xn) and {yi, . . . ^y„) If n = 2 , wo can think of Ta 
as a transformation of the cartesian plane which sends a pomt 
with coordinates (xi,X2) into a point with coordinates (2/1,1/2) 
Similarly, if n = 3 , we can think of Ta as a transformation which 
sends a point with coordinates (xijXo.xs) into a point with coordi¬ 
nates (2/1,2/2,2/3). If n > 3 , we can regard Ta as a transformation 
in a hyperspace of the appropriate number of dimensions, or we 
may think of it simply as a transformation of an n-component 
vector X into an Ti-component vector Y From the definition 
of matnc multiplication and the equality of two matrices, it is 
clear that if we introduce the matrices 



2/1 


a,i 

<*12 

air, 


Xi 

F = 

?/2 

A = 

^21 

^22 

■ a-in 

X = 

X2 


Vn 1 


o„i 

an2 ■ 

f^nn 


Xn 


then the transformation Ta can be written in the form 


( 4 ) Ta Y ^ AX 

The matrix A in Eq ( 4 ) is usually referred to as the matrix 
of the transformation Ta It is thus apparent that matrices are 
intimately related to linear transformations and systems of 
linear equations 

Suppose, now, that, in addition to the transformation Ta 
which transforms a vector X into a vector F, we have a second 
transformation 








fell 

bn ■ 

b In 

( 5 ) 

7 V 

Z ^ BY 

Z = 

2^2 

B = 

621 

622 

b 2 n 





Zn 



bn 2 ■ ‘ 

ban 


which transforms a vector Y into a vector Z If Ta is applied to a 
vector X and then Tb is applied to the resulting vector F, the 
net result is to transform the vector X into the vector Z, and it 
is a matter of some interest to find the equations of the equiva¬ 
lent transformation connecting X directly with Z. This can easily 
be done, of course, simply by eliminating the variables (2/1,2/2, 
. . . ,yn) between the equations of To and Th To do this we 
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observe that the equations of Ta and Tb can be written respectively 

n 

Ta. Vk = Yi k = \,2, . . . ,n 

n 

Tt. «• = 2 ^>kyk t = 1, 2, . ,n 

k-\ 

Hence, eliminating the y^s by substituting for yk m the equations 
of Thi we have 

n n n n 

2t = ^ ^ ^ ~ X ( S ^ ~ ,n 

*-1 j-i j-i *-i 

Thus the coefficient of Xj in the equation for z. is 

n 

X 

k~\ 

which IS precisely the element c„ in the product BA. In other 
words, the matnc form of the single transformation Tba equiva¬ 
lent tx) following Ta by Thy may be found simply by eliminating 
Y between Eq. (4) and Eq (5) 

Z -- BY = B{AX) = iBA)X 

Thus we have established the following important result- 


THEOREM 8 

The result of following a linear transformation Ta' Y = AX with the transforma¬ 
tion Tb Z = BY the single transformation Tba’ Z — BAX, whose matrix is 
the product BA of the matrices of Tb and Ta 

As a further illustration of the importance of matnc multi¬ 
plication, we return to the idea of transition probabilities whu ii 
we mentioned earlier in this section Suppose that a system 
can exist in any of n states *Si, *S 2 , , and that by some 

random process the system may pass directly from the ith state 
to the j\h state with probability (ij = 1, 2, , n) 

Naturally, the system may also pass from the zth state to the jlli 
state by first passing to some intermediate state, say the kih, 
and then passing from the kih state to the jth; and the calcula¬ 
tion of these two-step transition probabilities is a matter of some 
importance. Now the probability that the system passes from 
the ith state to the jth state via the fcth state is the product of 
the probability that it passes in one step from to Sk and 
the probability pij^ that it then passes in one step from Sk to 
Sj Furthermore, since in any two-step transition from S^ to Sj 
the system must pass through some intermediate state (including, 
of course, and Sj themselves) the probability p,^J^ that the 
system passes in exactly two steps from St to Sj is 

n 

_( 2 ) _ ^ « 0 )^( 1 ) 

Pij 2 j 
k^l 
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But the sum on the right in the last formula is precisely the ele¬ 
ment in the ith row and jth column of the square of the matrix 
of one-step transition probabilities, P = In other words, 

the mcUnx of two-step transition probabilities for any system S is 
the square of the matrix of one-step transition probabilities for S. 
A similar argument shows that the matrix of three-step transi¬ 
tion probabilities for S is the cube of the matrix of one-step 
transition probabilities, and so on 

EXAMPLE 3 

Let S be the eystem consisting of two players A and B who begin with two dollars apiece and 
metch coins until one or the other has no more money If the state:^ j 1 the system are defined 
hy the number of dollars in A 's possession, speeificallv, if the system is m the state aS.+i whenever 
.1 has 1 dollars (z — 0, 1, 2, 3, 4), find the matrix of one-step transition probabilities. Then, by 
raising this matrix to the second, third, and fourth powers, find the matrices containing the two-, 
three-, and four-step transition probabilities for S What is the probability that A will be ruined 
111 at moat four turns'^’ What is the probability that A will be ruined in exactly four turns'^ 
C-learly unless A or B is bankrupt, A mu.st either win a dollar or lose a dollar on each turn, 
and the probability of each of these events is Hence, if A has i dollars (i - 1,2, 3), that is, 
if tlie system is in the state + - (i = 1, 2, 3), the proliiibdity of a one-step transition t>o »S, is 1-^, 
the iirobability of a one-step transition to is and the probability of a one-step transi¬ 
tion to any other state is zero On the other hand, if the sy.stem is in the state <Si, that is, if A is 
bankrupt, the .system remains in that state, so the probability of a one-step transition from 5i to 
S] IS I, and the probability of any other transition from *S'i i.s 0 Similarly, if the system is in 
the state that it f ^ is bankrupt, (he system remains in that state, hence the probability 
of a one-atep transition from Si, to Si, is I, and the probability of any other transition is (1 Thus 
th(' matrix of one-.s(<‘p transition probabilitie.s i.s 

1 0 0 (» 0 

n h' 0 0 

- 0 4 0 4 0 

0 0 4 0 4 

0 0 0 0 1 

By multiplying this matrix by itself we find at once that the matrix of two-step transition 
probabilities is 

1 0 0 0 0 

4 H 0 0 

P*- 4 0 A 0 4 

0 4 0 4 4 

0 0 0 0 1 

Similarly, by computing P* and P*, we find the matrices of three-step and four-step transition 
probabilities, respectively, to be 


] 

0 

0 

0 

0 


1 

0 

0 

0 

0 

% 

0 

4 

0 

4 


H 

4 

0 

4 

4 

4 

4 

0 

4 

} 4 and 

p* = 

h 

0 

4 

0 

4 

4 

0 

4 

0 

4' 



4 

0 

4“ 

4 

0 

0 

0 

0 

1 


0 

0 

0 

0 

1 


The probability that A is ruined m at most four turns is simply the probability of a four-step 
fransition from S» to Si, namely, ■» since among such transitions are included those in 
''hich the system reaches Si m less than four steps and then remains there. The probability 
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that A IB mined in four turns and not before is the probability that S reaches 5i in four steps but 
does not reach it in three steps or less, namely, pJV ” PiV ^ H — H ^ H- 

EXCRCISCS 

1 Multiply the matrices 

1 2 

3.0 

using the indicated partitioning Check by multiplying without regard to the partitioning 

2 Evaluate the matnc polynomial X* — AX* — + 4/ for each of the following matrices 


a 

|l -111 

b 

1 

1 

2 

c 

0 

1 

1 


1 2 oil 


1 

2 

1 


-1 

0 

1 




2 

1 

1 


-1 

-1 

0 


8 Verify that {X - 31) (X - 2T) ~ (X - 21) (X - 31) - X* - 6X + 6/ for 

1 11 ^ ^ ® II 

* H and X - 0 3 0 

^ ^ 'I 0 0 4|| 

Do you think that this relation is an identity for all square matrices X? 

cos $ Bin 0 " cos n6 sin nd 

— sm 0 cos 0 I — sin n0 cos n0 
cosh 0 sinh 0 " cosh n0 sinh n0 
sinh 0 cosh 0 sinh n0 cosh n0 

0 Show that, if a matrix A commutes with a diagonal matrix D whose diagonal elements are 
all distinct, then i4 is a diagonal matrix Is A necessarily diagonal if the diagonal elements of 
D are not all distinct? 

7 If A and B are conformable matrices, show that the rth row vector in the product AB ib 
A tB where >4^ is the tth row vector of A What is the jth column vector in the product AB"^ 
1 2 -1 

8 If i4 ■■ 2 1 3 , find a nonzero 3X3 matrix X such that X is a zero matrix 

4 5 1 

Is XA — 0? Is X unique? 

9 If j 4 and B are symmetric matrices of the same order, prove that the product AB le sym¬ 
metric if and only if /I B - BA 

10 If A and B are two square matrices which commute and if r and « are positive integers, prove 
that A^ and B* also commute 
11 Prove Theorem 3 
12 Prove Corollary 1, Theorem 7 
18 Prove that (A + B)’’ - + B’’ 

14 IfX is a diagonal matrix whose diagonal elements are all equal to fc, prove that the product 
of K and any conformable matrix A is equal to the product of A and the scalar k Because of 
this property the matrix K is often referred to as a scalar matrix. 

16 By definition, the transpose of the matrix A — M.Jl is the matrix A^ ■ lla^.ll Is this 
formula correct if the oj/s are submatrices of A? 

18 By the derivative of a matrix A we mean the matrix whose elements are the derivatives 
of the elements of A Assuming that the elements of the matrices A and B are differentiable 
functions of x, use this definition to show that d(AB)/dx - (dA/dr)B A- A(dB/dx) Is 
dA*/dx - 2A{dA/dx)? 

It Show that in any matrix of transition probabilities, the sum of the elements in any row is 1 


4 Show that 
6 Show that 


i -i|| 


3 

1 

and 

1 

3 

: 211 


2 

0 
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18 Consider the system S consisting of four boxes Bi, Bt, B,, and Ba and a single ball, and let 
the system be in the state S, (i — 1, 2, 3, 4) if the ball is in the box B, Transitions from one 
state to another take place in the following manner A die is thrown and, if a 1, 2, or 3 turns 
up, the ball is taken from whichever box it may have been in and placed in the box bearing 
the number showing on the die If 4, 5, or 6 turns up, the ball is taken from wherever it may 
have been and placed in the box Ba Find the matrix of one-, two-, and three-step transition 
probabilities for the system 

19 Consider the system S consisting of three boxes Bi, Bj, and Bj and a single ball, and let the 
system be in the state S, (i =« 1, 2, 3) if the ball m in the box B* Transitions from one state 
to another take place in the following manner Three coins are tossed If no head’? turn up, 
the ball is not moved, but, if one or more heads turn up, the ball is taken from whichever 
box it may have been in and placed in the box torresponding to th« number of heads show¬ 
ing Find the matrix of one-, two-, thiee-, and four-step transition probabilities for the 
Rysiem 

20 Fhow that, in computing the product of a (p,q) matrix and a (qj) matrix, pqr multiplications 
and pr(q — 1) additions must be performed If a (p,g) matrix and a (q,r) matrix are conform¬ 
ably partitioned into four submatnees by one partition of their rows and one partition of 
their columns, prove that the same number ot multiplications and the same number of 
additions are required in multiplying the two matrices whether this is done in the original 
or in the partitioned form 


10.3 

Adjoints and inver^AS 

It IS a familiar fart of elementary algebra that any quantity Q 
not equal to zero has a reciprocal 

Q-i = 1 

^ Q 

with the property that 

QQ'^ = Q-^Q = 1 

The familiar process of division, which we sometimes inaccurately 
regard as being essentially independent of multiplication, is 
nothing but multiplication involving the reciprocal, or multi¬ 
plicative inverse, of the divisor as one factor. In matne algebra, 
although we do not define division as such, we can in an important 
class of cases define the reciprocal, or inverse, of a matrix. With 
reciprocals defined, multiplication then serves to accomplish all 
we might properly expect to do by division As usual our develop¬ 
ment begins with a number of definitions. 

We have already defined the determinant of a square matrix 
as the determinant whose array of elements is identical with the 
array of the matrix itself Clearly, only square matrices have 
determinants. A square matrix whose determinant is different 
from zero is said to be nonsingular. A square matrix whose 
determinant is equal to zero is said to be singular. Using these 
notions, we can now give formal definitions of the important con¬ 
cepts of the adjoint and the inverse of a matrix. 
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DEFINITION I 

If A = llotjll is a square matrix and if A., is the cofactor of in the determinant 
of A, then the matrix 

= transpose of ||A»J 
18 called the adjoint of the matnx A. 

The adjoint of a square matrix A is sometimes indicated by the 
notation adj A. 


DEFINITION 2 

The reciprocal, or inverse, A"‘ of a nonsmgular matrix A = ||aij|| is the adjoint 
of A divided by the determinant of A; i e , 


A“» = 


u.r _ ii^Ji 

1^1 w 


Clearly, although every square matrix has an adjoint, only 
nonsingular matrices have inverses. 

The fundamental importance of the reciprocal, or inverse, 
of a matrix is apparent from the following theorem 


THEOREM 1 

The product of a nonsingular matrix A and its recipro(‘al in either order is a unit 
matrix; i e , A'^A = AA~^ ~ I 

PROOF Let, A = ||a,;|| be a nonsingular matrix and consider first the product 



A 11 

Ail 



Ull 

a\i 

G\n 

II 

A\2 

An 

Ani 
Ann 1 


Gil 

Gii 

Gin 

1 

A i„ 

A in 



Gnl 

Gni 

Gnn 


Clearly, from the definition of inatric multiplication, the element m the ?lh row 
and jth column of the product of the two matrices on the right is the scalar 
product 

n 

X Akiakj 
ib- 1 


Moreover, from Corollary 1, Theorem 11, Sec 10 1, this sum is equal to \A \ if 
i = j and is equal to zero i 9 *^ j Hence, 


|A| 

0 

0 


1 

0 

0 

0 


0 

= 

0 

1 

0 

0 

0 

|A| 


0 

0 

1 


The proof that AA ‘ — / follow’s in exactly the same fashion 


/ 


as asserted 


COROLLARY 1 

For any square matrix, (adj A)A = A(adj A) = 1A|/. 

COROLLARY 2 

If A is a nonsingular matrix, then A'^ is also nonsingular and |A = 1/1A| 
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EXAMPLE 1 




1 

2 

4 

If 

A - 

-1 

0 

3 



3 

1 

-2 


then the determinant of A is 


1 

-1 

3 


2 4 

0 3 

1 -2 


- 7 


The adjoint of A is the tranBFK)sc of 



0 

3 


-1 

3 


-1 

0 



1 

-2 


3 

-2 


3 

1 



2 

4 


1 

4 


1 

2 



1 

-2 


3 

-2 


3 

1 



2 

4 


1 

4 


1 

2 



0 

3 


-1 

3 


~1 

0 



The inverse of A is, therefore, 



-3 

8 

6 

that IS 

7 

-14 

-7 


-1 

5 

2 


and 




-3 

8 


6 

A-> 

- 

7 

-14 

-7 



-1 

5 

2 


-3 

8 

6 


1 

A-A - .i 

7 

-14 

-7 


-1 


-1 

5 

2 


3 


2 

4 


7 

0 

0 


1 

0 

0 

0 

3 


0 

7 

0 


0 

1 

0 

1 

-2 


0 

0 

7 


0 

0 

i 


From Theorem 1 it is clear that, if i4 is a nonsingiilar matr'x, 
then each of the equations AX = / and XA = I has X = as 
one solution Actually, we have the following stronger result 


THEOREM 2 

If A IS a nonsingular matrix, then X = A~' is the unique solution of each of the 
equations AX = I and XA = 7. 

PROOF Consider first the equation AX = / If both X^ and Xi satisfy this 
equation, then AXy — AX^, since each is equal to 7 Moreover, since A is non¬ 
singular, it follows that A~^ exists Hence, premultiplying by A~^, we have 

A-^AX, = A'^AX^ 

IXi = 7 X 2 
Xi = X, 

Thus the equation AX = 7 has in fact just one solution, and from Theorem 1 
it follows that this solution is X = A~^ A similar argument shows that X = A~^ 
is also the unique solution of the equation XA = 7, as asserted. 

COROLLARY 1 

If A IS a nonsingular (n,n) matrix, if B is an (n,m) matrix, and if C is an (m,n) 
matrix, the equation AX = B has the unique solution X = A~^B, and the 
equation XA = C has the unique solution X = CA~^ 
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Various other important theorems follow easily now that 
the uniqueness of the solution of AX = / for any nonsingular 
matnx A has been established. In particular, we have the follow¬ 
ing results: 


THEOREM 3 

If A is a nonsingular matrix, then (A"‘)"^ = A. 

PROOF By Theorem 2, (A~0”* is the unique solution of the equation 
A~^X = I. However, it is obvious by inspection that X = A satisfies this 
equation Hence (A^^) i = A, as asserted 

THEOREM 4 

If A and B are nonsingular (n,n) matrices, then (AB)~^ = B~^A~^ 

PROOF By Theorem 2, {AB)~^ is the unique solution of the equation 
{AB)X = /. However, it is clear that X = B ^A~^ satisfies this equation, since 

(AB)(B-iA >) = A(BB"i)A-i = A/A-i = AA'i = I 

Hence, (AJ5)"^ = B^^A~^, as asserted 

COROLLARY 1 

If A, B, , . . , X arc nonsingular (n,n) matrices, then 

(AB • X)-i = X-i ■ X-iA-i 

With the inverse of a nonsingular matrix defined, it is now 
possible to define negative integral powers of any nonsingular 
matrix: 

DEFINITION 3 

If A is a nonsingular matrix and if r is a positive integer, then A~^ = (A“i)’' 

Negative powers of singular matrice<^' are not defined 

For noiisingular matrices it is now possible to extend the 
familiar laws of exponents to negative as well as nonnegative 
integral powers 


THEOREM 5 

If A is a nonsingular matrix, then, for all integral values of r and s, A''A* — A'"*'* 
and (A’’)' = A". 


If in the corollary of Theorem 2 we take B to be the column 
matrix 

bi 

bn 
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the matnc equation AX = B is equivalent to the system of 
nonhomogenous linear equations 

-h cinXi -h ■ -h dinXn = hi 

Cl2lXl H- (I21X2 + ' -f- dinXn = hi 

anlXl -I- a„ 2 l 2 + ‘ • + a^nXn = bn 

Hence, it is clear from Corollary 1 , Theorem 2 , that the solution 
of this system exists and is uniquely given by 

X = A-^B 

if A is nonsingular 

Similarly, if we take B to be the matrix 
2/1 

Y = 

yn 

the matnc equation AX — B becomes the linear transformation 

Y = AX 

The corollary of Theorem 2 now assures us that if A is non- 
singular the inverse of this transformation, that is, the transfor¬ 
mation that carries us back from the vector Y to the vector X, 
^ unique and has the equation 

X = A-^Y 

As a physical illustration of the relation of a matrix and its 
inverse, let us con.sider the mass-spring system shown in Fig 10 1 
and determine the forces which act on each of the masses as a 
result of arbitrary displacements xi, X 2 , and Xa of the respective 
masses. The modulus of each spring is the indicated value of k) 
that IS, the force required to stretch each spring a unit distance 
IS the corresponding value of k Now, if the masses are displaced 
by the respective amounts xi, X 2 , and X 3 , the increases in the 
length of the various springs are 


ki. 

Xi 


kii'. 

Xi 

- Xi 

kill 

Xi 

- Xi 

^28' 

Xi 

- Xi 

ki: 


- Xi 


figure 10.1 

A typical system 
of Bpring- 
oonneoted 
maafles. 
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and the forces represented by these changes in length are 


*1: 

kiXi 

ku: 

ku(x% - xi) 

ku'. 

fcia(x* - Xi) 

kiz'. 

^2j(Xj X2) 

kz: 

kz(-Xz) 


a positive force indicating that the spring is stretched and a 
negative force indicating that the spring is compressed. Hence, 
taking due account of the direction of the force applied to each 
mass by each spring attached to it, we find that the forces/i, / 2 , 
and /a which act on the respective masses are 

/l = -k^Xi -h A;i2(X2 - X\) -h A;i 3(X8 - Xi) 

/a = -kn{Xi - Xi) + fc23(x8 - Xt) 

/> = —kn{Xi — Xi) - A;js(x 8 - Xj) - fcgXa 

or, collecting terms and rewriting in matric notation, 

F = KX 
where 

/i 

U 

fi 

and 

~ (k\ 4“ ki2 4“ kii) k\2 kn 

K = ki2 ~ikl2 4“ ^ 23 ) ^23 

ku k23 —{ki^ 4“ A:23 4“ fcs) 

Evaluating the first of Eqs ( 1 ) for xi = 1 , X 2 = 0, xa = 0, it is 
clear that — (/tj 4~ ku 4- ku) is the force applied to the first 
mass as a result of a unit displacement of that mass. A similar 
evaluation shows that, in general, the element in the ith row 
and jth column of K is the force applied to the tth mass as a 
result of a unit displacement of the jth mass. Because of this 
property the matrix K is usually referred to as the stiffness matrix 
of the system. 

It can easily be verified that, for all positive values of the 
fc’s, the matrix K is nonsingular Hence, for the physical system 
shown in Fig 10 1, K~^ exists, and we can solve Eq (2) for X, 
getting 

X = K'^F 

Now, evaluating the right-hand side of this equation for a force 
vector with one component 1 and the rest 0 , it follows that the 
element of K~ ^ in the tth row and jth column the displacement 
produced m the ith mass as a result of a unit force applied to the 
7 th mass Because of this property, the matrix K~' is usually 
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referred to as the elasticity matrix* of the system. Our discussion 
has thus illustrated the important fact that for any elastic system^ 
the elasticity matrix is the inverse of the stiffness matrix, and vice 
versa. 

In the last section we defined a number of special matrices, 
and now, with the concept of the inverse of a matrix available, 
our list can be extended to include several additional important 
types In the following table we bring together the types we have 
already defined as well as the new ones we are here intr iducing: 

tabu 10.1 


A “ conjugate of A 
yl ^ — transpose of A 
— associate of A 

=» inverse or reciprocsl of A nonsingular) 


Condition on A 


Type 


A • A 
A ^ -A 
A A'*' ' 

A =» -A'T 
A « 

A - A^ 

A = (AT')-i, 1 e , .4-' » A^ or AA^' » / 
.4 = le, A-^ « i^or AA'^ - / 


Real 

Imaginary 

Symmetric 

Skew-symmetric 

Hermitian 

Skcw-hermitian 

Orthogonal 

Unitary 


Although wc cannot go into the details of the matter, it is 
worth noting that orthogonal inal rices derive their name from 
the fact that the matrix of a transformation which is a rotation 
of mutually perpendicular, or oithogonal, axes in two or three 
dimensions is always orthogonal For instance, it is well known 
that in the cartesian plane the equations of a general rotation 
of axes are 


x'l = Xi cos a ^2 sin a 
x\ = —xi sin a A- X 2 cos a 


where X' = 

x^ 

1 / 

A = 1 

cos a sin a 

X =! 

Xi 

1 

! 

1; 

— sm a cos a 

ii 

Xi 


and it is easy to show that A is orthogonal by verifying that 
AA^ = I. 


* The symmetry of the stiffness and elasticity matrices, which asserts, for 
instance, that the force acting on the ith mass as a result of a unit displace¬ 
ment of the jtli mass is equal to the force acting on the jih mass as a result 
of a unit displacement of the ith mass, is an illustration of the famous reci¬ 
procity theorem of Maxwell-Rayleigh-Betti. This theorem is the counterpart 
m mechanics of what is known simply as the reciprocity theorem m electrical 
circuit analysis. 
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EXERCISES 

1 Prove Corollary 1, Theorem 4. 

2 Find the adjoint of each of the following matrices, and, when it exists, find the inverse 


1 2 

b 

2 

-1 

3 

c 

1 

1 

1 

d 

2 

3 

1 


4 

0 

-1 


1 

2 

3 


1 

-1 

2 

3 4 


3 

3 

2 


3 

2 

1 


1 

9 

-4 


8 a Under what conditions, if any, does AB ^ AC imply B » C? 
b If /t 18 a nonsingular matrix, show that AB ^ 0 implies B ~ 0 

4 If is a nonsingular matrix which commutes with a matrix B, prove that A~^ commutes 
with B If B IB also nonsingular, do yl"* and /i"‘ commute? 

5 If D IS a nonsingular diagonal matrix, prove that Z)~' is also a diagonal matrix and that eacli 
element on the principal diagonal of is the reciprocal of the corresponding element in D 
Does a similar result hold for nonsingular triangular matrices? 

6 If A IS a singular matrix, prove that the product of A and its adjoint is a null matrix 

Xi ^ X2 2xa =* 1 

7 Solve the system 2x\ — ii -■ 2 by multiplying both sides of the equivalent 

Ji “h H" Xs “ 3 

matne equation AX — ^ by the inverse of the matrix of the coefficients, 

8 If A IS a nonsingular matrix, show that the determinant of the adjoint of A is equal to tlu* 
(n — Dst power of the determinant of A 

0 If A IB a nonsingular matrix, show that the adjoint of the adjoint of A is equal to A times 
the (n — 2)nd power of the determinant of A 

10 Prove that the detci minant of any orthogonal matrix is either 1 or — 1 Is the converse truc'^ 

11 Prove that a real matrix is orthogonal if and onlv if its column vectors are unit vectors whicli 
are mutually orthogonal 

18 Prove that, if the column vectors of a real matrix A are mutually orthogonal unit vectors, 
so are the row vectors of A 

IS Show that, for all positive values of the/c’s, the matrix K in Eq (2) is nonsingular 

14 Find the stifTnoss and elasticity matrices for the system shown in Fig 10 2 



10 In mechanics it is shown that, if a cantilever beam bears a concentrated load P at a (IIS'- 
tance s from the fixed end, then the deflection y at a distance x from the fixed end is given 
by the formula* 


y 


Px\x - 3a) 
6 £/ ^ 
Pa«(a - 3x) 
6F7 


X < a 
X ^ a 


• The theory required for the derivation of this result is summarized m 
Sec. 2.0. 
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where E and I are physieal constants of the beam Using this formula, obtain the stiffness 

h 2L 

and elasticity matrices relating the forces and deflections at the positions ® 

L 2L ^ ^ 

and what respect, if any, does this problem differ significantly from 


the example discussed in the text? 


10.4 

Rank and the equivalence of matrices 

One of the most important charactenstjcs of a matrix is its rank: 
DEFINITION 1 

The ran k of a matrix A is the largest value ol r for which tliere exists an (r,r) sub- 
matrix ofjl with non vain sTilng determinant. 

The rank of a matrix A, as ^ve have just defined it, is sometimes 
refened to more specifically as the determinant rank of A. 
Clearly, as an immediate consequence of Theorem 1, Sec. 10 2, 
w^e have the following simple but useful result 


THEOREM 1 

If A and B are o {n,n) matrices of rank n, then botli AB and BA are of rank n. 
EXAMPLE 1 



] 

2 

-1 

3 








The matrix 


4 

0 

-1 

lb of 

rank 2, 

Since each of the third- 

order submatrices 


-1 

0 

-2 

7 









2 

-1 

3 1 

1 

1 

-1 

3 

I'i ’ 

2 3 

1 

1 

2 -1 


4 

0 

-1 

1 


0 

-1 


4 - J 


3 

4 0 


0 

-2 

7 1 

1 

-1 

- 2 

7 

1 

0 7 


~1 

0 -2 


is singular while not all second-ordei subniatnrrS aie singular Specifically, the determinant of 
the 2X2 Hubmatnx in the upper left-hand corner is different from zero. 


In working with matrices it is frequently necessary to 
consider the effect of performing upon them certain simple 
manipulations known as elementary transformations: 

definition 2 

An elementary transformation of a matrix is any one of the following operations: 

a The multiplication of each element of a row or a column by the same nonzero 
constant 

b The interchange of two rows or of two columns 

c The addition of any multiple of the elements of one row, or one column, to 
the corresponding elements of another row, or column, respectively 

The most important property of elementary transformations 
is contained in the following theorem. 
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THEOREM 2 

The rank of a matrix is not altered by any sequence of elementary transformations. 

PROOF Let A be an arbitrary matrix, and let r be its rank. Then every minor 
of A of order greater than r is zero, and at least one minor of order r is aifferent 
from zero To prove the theorem it is clearly sufficient to prove that no elemen¬ 
tary transformation can change the rank of A. 

Consider first an elementary transformation of type a. By Theorem 6, Sec 
10.1, such a transformation cannot affect the vanishing or nonvanishing of any 
minor of A ; hence it cannot alter the rank of A 

A transformation of type b, on the other hand, may affect the vanishing or 
nonvanishing of the minor in some particular position in A. However, after a 
transformation of type b every submatrix m A exists somewhere in the resulting 
matrix, with at most two rows or two columns interchanged Hence, by Theorem 
7 , Sec. 10.1, if all minors of A of order greater than r are zero, the same thing will 
be true after the transformation is performed, and if at least one rth-order minor 
of A IS different from zero, the same thing will be true after the transformation 
Thus no transformation of type b can alter the rank of A 

Finally, no transformation of type c can alter the rank of A. For consider 
the transformation consisting of modifying the elements of the 7th row by adding 
to them some multiple X of the corresponding elements in the ith row (The case 
of column modification is handled by an identical argument.) Clearly, some of the 
(r + l)st-order minors of A are unaffected by this transformation Specificallv, 
any (r + l)st-order minor involving neither the zth nor the 7th rows, both the 
tth and the 7th rows, or just the zth row will Mirely be unaffected, i.e., will be left 
equal to zero On the other hand, the value of an (r -|- l)st-()rder minor involving 
the 7th row but not the zth may conceivably be affected, since one of its rows 
(the 7th) IS modified by means of a row of elements (the zth) from outside the 
minor. However, by the addition theorem for determinants (Theorem 9 , Sec 10 1 ) 
the modified determinant can be written in the form 

l^il -f- Xj^Sal 

where iSi and S2 are square submatrices of A of order r + I and hence singular, 
by hypothesis Thus no vanishing (7 -h l)st-order minor of A can be transformed 
into one which is different from zero by a transfornnition of type c, that is, no 
transformation of type c can increase the rank of A On the other hand, no trans¬ 
formation of tj'pe c can decrease the lank of A, either Foi if this were the case, 
then the inverse transformation, that is, the transformation consisting of adding 
— X times the elements of the zth row to the corresponding elements of the 7th 
row m the new matrix, would be a transformation of type c which restored the 
matrix to its original form and hence increased its rank to the original value r, 
and this we have just proved to be impossible Thus the rank of A, being neither 
increased nor decreased by a transformation of type c, is invariant under this 
transformation also, and our proof is complete. 


DEFINITION 3 

Two matrices A and B, one of which (and hence either of which) can be obtained 
from the other by a series of elementary transformations, are said to be equivalent 
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It is interesting and important to note that any elementary 
transformation involving the rows of a matrix A can be accom¬ 
plished by premultiplying by a unit matrix on whose rows 
the same elementary transformation has been performed, and 
any elementary transformation involving the columns of / can 
be accomplished by postmultiplymg A by a unit matrix on whose 
columns the same elementary transformation has been performed. 
More specifically, we have the following theorems, whose proofs 
follow immediately from the definition of matric rnu'tiplication: 


THEOREM 3 

If A is an arbitrary (?n,n) matnx and if AI (N) is the matrix obtained from the 
identity matrix 1 „ (/„) by multiplying the elements in the ith row (column) by X, 
then the product MA (AN) is identical with A except for the ^th row (column) 
which consists of the elements of the ?th row (column) of A each multiplied by X. 

THEOREM 4 

If A IS an arbitrary (w,n) matrix and if M (N) is the matrix obtained from the 
identity matrix ( 7 „) by interchanging its ith and;th rows (columns), then the 
product AfA (AN) is identical with A except for the zth and jth rows (columns) 
which are interchanged 

THEOREM 5 

If A IS an arbiti^ry (m,n) matrix and if Af (N) is the matnx obtained from (In) 
by adding to the elements of the ^th row (column) X times the corresponding 
elements in the ith row ((column), then the product A/A (AN) is iriontical w’ltb A 
except for the ^th row (column) which consists of the elements of the ^th row 
(column) of A plus X times the corresponding elements m the ?lh rf)w (column) 
of A 

From the preceding theorems it is clear that a sequence 
of elementary transformations Fi, T2, , Tk on the rows 

(columns) of an (m,n) matrix A can be accomplished by prcinulti- 
plying (postmultiplymg) A by a sequence of matrices Af 1, A/z, 

. . , Afk (Ni,N2y ,Nk) each obtained from the identity 

matnx (/„) by performing upon its rows (columns) the 

same elementary transformations The product Afk _ ilfzMi 

(A^iA^z Nk) of (he matrices by which A is premultiphed 
(postrnultiplied) can, of cours^^, be expressed as a single matrix 
P (Q), necessarily of rank m (n) since it is the product of matri¬ 
ces each obtained from Im (fn) by elementary transformations 
and each therefore of rank m (n). We have thus established the 
following important theorem’ 

theorem 6 

If A and B are equivalent matrices, then B = PAQ, where P and Q are non¬ 
singular matrices 

In view of the way the nonsingular matrices P and Q of the 
last theorem were obtained, it is interesting to inquire whether, 
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conversely, any nonsingular matrix can be obtained from the 
corresponding identity matrix by elementary row transformations 
or elementary column transformations. The answer is Yes, as 
the following pair of theorems makes clear: 

THEOREM 7 

Any nonsingular (n,n) matrix can be reduced to the identity matrix /„ either by 
elementary row transformations or by elementary column transformations 

PROOF Let P = ||p,j|| be an arbitrary nonsingular (n,n) matrix. Because P 
is nonsingular, at least one element in the first column must be different from 
zero; and it is no specialization to assume that pn 7^ 0, for if this is not the case 
the interchange of two rows will bring a nonzero element into the leading position. 
Since pn 5^ 0 , the leading element m the first column may be reduced to 1 by 
multiplying each of the elements m the first row by l/pn Then by subtractiiiR 
the appropriate multiple of the first row from each of the other rows we obtain 
the matrix 

1 ru rn • • 

0 raa raa r^n 

0 rn2 Tni * ’ * fnn 

Since the original matrix, and therefore the last one, is noiisingular, it follows 
that the submatnx 

• • Tin 
Tnn 

is nonsingular. Hence the same reduction can be applied to it, and thus, continuing 
the process sufficiently, we obtain an upper triangular matrix 

1 S12 513 

0 1 ^23 ■ ' 82n 

0 0 1 ' San 


0 0 0 ■ • • 1 

Finally, working upward by row operations similar to those we have just em¬ 
ployed, the elements above the diagonal can all be reduced to zero. This proves 
the assertion of the theorem for reductions involving only elementary row trans¬ 
formations. A similar argument shows that P can also be reduced to the identity 
by means of elementary column transformations. Thus the theorem is established. 

THEOREM 8 

Any nonsingular (n,n) matrix can be obtained from the identity matrix In by a 
sequence of elementary row transformations or a sequence of elementary column 
transformations. 



PROOF If 72 is any nonsingular (n,n) matrix, we know from the last theorem 
^IjAt k sequence of elementary row transformations can be found which will 
1 ‘eauce 72 to /«. Then, by Theorems 3, 4, and 5 , we know that there exist corre- 
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sponding matrices Mi, M2, . . . , Af* such that 
7n = ■ MiMiR 

Postinultiplying this equation by 72 “\ which of course exists since R is non- 
singular, we have 

(1) J2-1 = M* ■ ■ • M2MJn 

In other words, if we multiply /„ by the matrices corresponding to the elementary 
row operations by which we reduce R to /„, the result is R~^. Thus, if we have a 
nonsingular matrix P, which we wish to obtain from the correspondir g identity 
matrix by a sequence of elementary row transformations, we need only take the 
matrix R in Eq (1) to be P"\ since (P“^)“^ = P; that in, *0 obtain P we need 
only apply to / the successive row operations by which is converted into I 
A similar argument shows that an arbitrary nonsingular matrix P can also be 
obtained from the corresponding identity matrix by a sequence of elementary 
column transformations. 

Incidentally, Eq (I) provides a method for determining 
the inverse of a matrix R which is of some practical value, since 
the matrices M\, M2, . , Mk can easily be found from the 

straightforward process of reducing R to the identity matrix. 

EXAMPLE 2 

Find a sequence of elementary row transformations which will reduce the matrix 



1 

2 

0 

p - 

2 

3 

-1 


-1 

-1 

2 


to fj, determine the matrices M\, M 2 , , corresponding to these transformations, and use 

these results to compute the inverse of P 

By inspection it is clear that P can be reduced to It by the following sequence of row 
operations 







1 

0 

0 




1 

2 


0 

r. 

Row 2 — 2 Row 1 

M, 


- 

2 

1 

0 

M,P 



0 

-1 

- 

1 






0 

0 1 



- 

1 

-1 


2 





1 

0 

0 




1 


2 

0 



Row 3 -H Row 1 

Mi 

- 

0 

1 

0 


MiM^P 

- 

0 

- 

1 

-1 






1 

0 

1 




0 


1 

2 






1 


0 

0 



1 

2 

0 


Tt 

- Row 2 

Mt 


0 

- 

1 

0 

MtMiM.P 


0 

1 

1 






0 


0 

1 



0 

1 

2 






1 


0 

0 



1 

2 

0 


Tt 

Row 3 — Row 2 

Mt 


0 


1 

0 

MtMtMiMiP 

- 

0 

1 

1 






0 

- 

1 

1 



0 

0 

1 






1 


0 

0 



1 

2 

0 


Tt 

Row 2 — Row 3 

Mt 

- 

0 


1 

-1 

MtMiMtMiMxP 

- 

0 

] 

0 






0 


0 

1 



0 

0 

1 






1 

- 

•2 

0 



1 

0 

0 


Tt. 

Row 1 - 2 • Row 2 

Mt 

- 

0 


1 

0 

MtMtMiMiMtMiP 

- 

0 

1 

0 






0 


0 

1 



0 

0 

1 
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The inyerae of the g:iven matrix can now be found either by using Eq. (1), namely, 

P-» - MjajiiAMtMtMJi 

or simply by performing on 1% the same sequence of row transformations used to reduce P to 7, 

- T^TiTiTiTtTiIi 

The result, by either method, is 



-5 

4 

2 

p-l - 

3 

-2 

-1 


-1 

1 

1 


With Theorem 8, we can now prove the converse of Theo¬ 
rem 6; 


THEOREM 9 

If 5 =■ PAQj where P and Q are nonsingular matrices, then A and B are 
equivalent. 

PROOF By Theorem 8, P can be obtained from the corresponding identity 
matrix by a sequence of elementary row transformations, and Q can be obtained 
from the corresponding identity matrix by a sequence of elementary column 
transformations Thus, as in the proof of Theorem 8, there is a set of matrices 
Afi, Mif . . . , Mki each representing some elementary row operation, such that 

P = Af* • • MaMi 

and a set of matrices NN2, , A^i, each representing some elementary 

column operation, such that 

Q = N,N, Ni 

Hence, B = PAQ = (M, M2M,)A{N,N2 ’ ' Ni) 

which proves that B is obtained from A by elementary row and column trans¬ 
formations and, hence, is equivalent to A, as asserted 

By a proof almost identical with the proof of Theorem 7, 
we can prove the following theorem: 

THEOREM 10 

Any (m,n) matrix of rank r can be reduced by elementary transformations, which 
in general will involve both rows and columns, to an (m,n) matrix in which a„ = 1 
(i = 1, 2, . , r) and all other elements are zero 

From Theorem 2 it is clear that equivalent matrices have 
the same rank. In view of Theorem 10 , it is clear that, given 
two (m,n) matrices of the same rank, each can be reduced by 
elementary transformations to the same standard form, and, 
hence, each can be reduced to the other, via the standard form, 
by elementary transformations. Thus we have established the 
following important theorem: 




SK. 10.4 


RANK AND THE EQUIVALENCE Of MATRICES 


theorem 1 1 

Two (w,n) matrices are equivalent if and only if they have the same rank. 

The equivalence relation 
B = PAQ P^Q nonsingular 

is a very general one, and many applications involve special 
cases in which P and Q satisfy additional conditions. These can 
all be thought of as transformations of a matrix A into s matrix B, 
and the usual terminology reflects this point of view. The follow¬ 
ing table summarizes the various cases of particular interest: 


table 10 2 


If P,Q are arbitrary 
nonsingular niatncea 

P = PAQ 

IS an equivalence transformation 
anil B IS equivalent to .1 

If P = Q 

I 

B = Q KiQ 

18 a similarity transformation 
and B is similar to A 

If P = 


B - Q'^'AQ 

18 a congruence transformation 
and B is congruent to A 

If P = (P 

- Q-i 

B = Q-^AQ 
- Q-'AQ 

18 an orthogonal transformation 
and B is orthogonally similar to A . 

If P = 


H = 

= Q-'AQ 

iH a unitary transformation 
and B is unitarily similar to i 


EXERCISES 

1 If a matrix is of rank r, i.s it poHSiblo that for Borne value p, le.ss than r, all minors of order p 
arc equal to zero? Why"^ 

2 Determine the rank of each of the following inatriees 


a 

3 

6 

-1 

2 

2 

-4 

4| 

1 

b 

2 

1 

5 

-1 

-2 

0 

3 II 

3 




’■ 

' 


1 

2 

3 

4 

c 

i 

2 

3 

4 


2 

3 

4 

5 


2 

1 

4 

3 


3 

4 5 

6 


3 

0 

5 

-10 


4 

5 6 

7 







5 

6 7 

8 


S Determine the rank o-f each of the following matrices as a function of X 


a 

1 

1 

00 

b 

1 - X 1 1 


-2 3 - 2X -1 


1 3 - X 3 


0 -1 2(1 - X) 


2 1 4 - X 


c 5 - X 4 -2 

4 6 - X -2 

-2 -2 3 - 2X 
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4 

6 

6 


7 


6 


9 


10 


If A is an (m,l) matrix and B ib & (l,n) matrix, show that the rank of the matrix AB is 1 
Prove Theorem 10 

Prove that the relation of equivalence has the following properties ■ 
a Every matrix is equivalent to itself 
b If i4 is equivalent to B, then B is equivalent to A. 

c If is equivalent to B and B is equivalent to C, then A is equivalent to C. 

Do the other relations listed in Table 10 2 have these properties? 
a Work Example 2 using only elementary column transformations 


b Work Example 2 if P is the matrix 


Show that A 


Show that A 


0 10 
I 1 2 1 

matrices P and Q, such that B " FAQ 

'1 0 1 0 
1 2 1 
1 1 2 

matrices P and Q such that B — PAQ 


and B 


and B — 


Show that A - 


2 1 0 

1 2 1 

4-1 -2 


and B 


2 

1 

2 

0 

1 

1 

1 

1 

1 

1 

0 

0 

0 

1 

1 

1 

1 

0 

0 

1 

1 

2 

1 

1 


2 


H - 

1 



0 

- 


are equivalent, and find nonsingular 


are equivalent, and find nonsingular 


are equivalent, and find non- 


singular matrices P and Q such that B PAQ 


10.5 

SysUms of linoor oquations 

Determinants and matrices find their most important application 
in the study of linear dependence and independence and m the 
closely related problem of t he solution of systems of simultaneous 
linear equations 

DEFINITION 1 

The quantities Qi, Q2, . , Q„ are said to be linearly dependent if there exists n 

set of constants Ci, C2, . , r„, at least one of winch is ditTercnt from zero, such 

that the equation 

ClQl -h C2Q2 -b + CnQn = 0 

holds identically 

DEFINITION 2 

The quantities Q2, , are said to be linearly independent if they are 

not linearly dependent; 1 e , if the only linear equation of the form 

C\Q\ 4 - C 2 Q 2 4 • '4 c^Qn — 0 

which they satisfy identically has 


Cl = C2 


c„ = 0 
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theorem 1 

If the quantities Qi, Qa, . . . , Q„ are linearly dependent, then at least one 
(though not necessarily each one) of the quantities can be expressed as a linear 
combination of the remaining ones. 

PROOF Since Qi, Qj, . , are linearly dependent, they necessarily satisfy 

a linear equation of the form ciQi -f C2Q2 + + c^Qn = 0 in which at least 

one of the c’s, say c„ is different from zero This being the case, we can divide 
by c,, getting 



which expresses Q, as a linear combination of the ren'ajiiing as asserted 
Since some, though not all, of the c’s may be zero, it follows that we may not be 
able to solve for each of the Q’s in this fashion 

EXAMPLE 1 

Show that the quantities 1 , t, and x* are linearly independent 

If 1, X, and I* are not linearly independent, they must satisfy identically some linear equa¬ 
tion of the form 

c,(l) + c,(z) + c,(x>) - 0 

in which at least one of the r’s is different from zero However, evaliinting this identity for the 
particular values x * — 1 , 0 , 1 , we obtain the three equations 

Cl - Cj + ci - 0 
Cl — 0 

Cl + cj 4 - C3 “ 0 

and, by inspection, the only solution of this system is ci =• f 2 * Cj — 0. Since this contrsoicts 
the assumption of linear dependence, the given quantities must be linearly independent, as 
asserted 


EXAMPLE 2 

Show that the vectors 


1 


2 


0 


4 

2 

V, - 

-1 

V, = 

1 

V, - 

-1 

3 


3 


-1 


5 


are linearly dependent 

These vectors will be linearly dependent if and only if constants ci, cj, Ca, and C 4 exist such 

that 

a At least one of them is different from zero 


1 


2 


0 


4 


0 

2 

+ Cl 

-1 

4- Cl 

1 

4" C 4 

-1 

- 

0 

3 


3 


-1 


6 


0 


Condition b is, of course, equivalent to the three scalar equations 

Cl -h 2ci + 4 c4 - 0 

2ci — ci + ci - C4 - 0 

3ci + 3ci — Cl + 5 c 4 - 0 

and it is not difficult to verify that these are satisfied by the values 


Cl ■■ 0 Ci — 2X 


Ci » X C 4 —X X arbitrary 
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and by no others. Hence the four vectors are linearly dependent and, in fact, are connected by 
the relation 

OF, 4- 2F, + Fa - F 4 - O 

and (except for constant multiples of this) no others From this it is obvious that Fj, Fa, and F 4 
can each be expressed in terms of the remaining vectors of the set, but that F, cannot be so 
expressed.* 

On the other hand, the vectors Fi, Fi, and Fa are linearly independent, since an equation of 
the form f,F, -}- c*F 2 + caFj - 0, that is. 



1 


2 


ol 

0 

Cl 

2 

-f- C2 

-1 

+ c, 

1 » 

0 


3 


3 


-1 1 

0 


implies that 

c, + 2 c 2 “ 0 

2ci — C 2 + fa “ 0 
3ci -f 3r2 — fa - 0 

and by direct solution we find that the only values which satisfy this system of equations are 
Cl “ C 2 “ Ca "* 0 Similarly we can verify that Fi, F 2 , and Va are independent and that Fi, Fa, 
and F 4 are independent However F 2 , Fa, and F 4 are dependent, since, as we observed above, they 
satisfy the relation 2 F 2 -|-Fa — F 4 -O 

As a Simple application of the notion of linear independence, 
we have the following useful result 

THEOREM 2 

If Fi, Fa, , Vm are m vectors each having n ^ m components and if lor 

* ” 2, . , 7 n the first (the last) nonzero component of F, is the tth [the 

(n - w -f i)thl, then Fi, Fa, . , Vm are linearly independent 

PROOF By hypothesis, the given vectors arc of the form 


Vu 


0 


0 


0 

V2l 


V 22 


0 


0 

t'ai 

Fa = 

Vu 

c, = 


F„. = 

0 

Vm\ 


Vm2 


Vm'\ 


Vmm 

Vnl 


Vn2 


Vn3 


Vnm 


where Vu, V22, , Vmm are all different from zero Now, since each vector 

has n components, the condition CiFi -f- raVo -f + CmVm = 0 implies n 

scalar equations, the first m of which an* 

CiVu = 0 

01^21 “b C2l'22 = 0 

Ci^si “b Cai^aa -b = 0 

Cll^ml “b C2Vm2 + C^VmZ + * ‘ “b Cm^mm = 0 

• Of course it is possible for a set of dependent quantities Q,, Qi, . . , Qn 

to satisfy more than one independent linear equation. In problems where this 
occurs, it may well be that some of the equations can be solved for Q,, say, 
while the others cannot. Naturally, if even one equation can be solved for 
then Qt can be expressed m terms of the other members of the set 
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Hence, since vn, 1^22, 1^53, . , Vmm are all different from zero, it follows that 

=- C2 — C3 = - Cm - 0 Therefore the vectors Vi, Fa, ^3, . . , F^ are 

linearly independent, as asserted A similar argument establishes the parenthetical 
assertion of the theorem. 

From Examples 1 and 2, it is clear that questions concerning 
linear dependence and independence are closely related to the 
solution of systems of simultaneous linear equations, and to 
these we now turn our attention In the most general case we 
have a system of the form 

ai 2 X 2 “h + dln^n = bi 

(1) -b -|- a^nXn = ?>2 

OmlXl + am2J:2 d" + amnXn = 

where m, the number of equations, is not necessarily equal to n, 
the number of unki'owns If at least one of the ni quantities 6, is 
different from zero, the s\stem i.s said to be nonhomogeneoua. 
Jf fi, = 0 for all values of /, the svsteni is said to be homogeneoua. 
If we define the matrices 



Oil 

au 

In 


Xi 

1 

bi 

A - 

^21 

Q22 

fl2n 

X = 

X 2 

B = 1 

62 


1 dtnl 


O’tnn 1 


Xn 

1 

b„ 


•^hc system can be written in the compact matric form 
( 2 ) AX = B 

In this form, the matrix A is known as the coefficient matrix of 
the system and the matrix 

IM^II 

obtained by adjoining the column matrix B to the coefficient 
matrix A is known as the augmented matrix of the system. 

Before proceeding to the (|ue.stion of the existence and deter¬ 
mination of solutions of (2), w(‘ shall first prove several important 
theorems about such solutions on the assumption that they exist:* 


THEOREM 3 

It Xi and X2 are two .solution vectors of the homogeneous matric equation 
AX 0 , then, for all values of the scalar constants Ci and C2, the vector c^Xi -h 
C2A'2 is also a solution of A A = 0 

PROOF By direct substitution we have 

AiciXi + C 2 X 2 ) = A(ciAi) + A{c2X2) 

= ci(AA0 + C2{AX2) 

= cj 0 -|- C2 ■ 0 

= O 


* It IS interesting to note the striking resemblance between the next three 
theorems and Theorems 2, 3 of Sec. 2.1 and Theorems 1, 2, 3 of Sec 4 5. 
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where the coefficients of Ci and C2 vanish because, by hypothesis, both Xi and X2 
are solutions of AX = 0 . Hence, CiXi -b C2X2 also satisfies AX = 0 , as asserted 

THEOREM 4 

If k is the maximum number of linearly independent solution vectors of the sys¬ 
tem AX = 0 and if Xi, X2, . - , Xk are k particular linearly independent 

solution vectors, then any solution vector of AX = 0 can be expressed in the 
form 

C\X\ C2X2 4 - ■ ■ “b CkXk 

where the c’s are scalar constants. 

PROOF Let k be the maximum number of linearly independent solution 
vectors of the equation AX = 0 , let Xi, X2, . , X* be a particular set of k 

linearly independent solution vectors, and let Xk^-i be any solution vector If 
Xjt+i is one of the vectors in the set (Xi,X2, . . . ,Xkl the assertion of the theo¬ 
rem is obviously true If Xfc4_i is not a member of the set (Xi,X2, . . ,Xjt| then 
Xi, X2, . . , Xfc, Xk+i cannot be linearly independent, since, by hypothesis, k is 

the maximum number of linearly independent solution vectors of AX = 0 
Hence, the X's must satisfy a linear equation of the form 

( 3 ) CiXi -b C2X2 + + CkXk -b cjk+iXk+i = 0 

in which at least one c is different from zero In fact, Ck+\ ^ 0 , for otherwise 
Eq. ( 3 ) would reduce to 

CiXi 4 - C2X2 4 “ + CjfcX* = 0 

with at least one of the c's different from zero, contrary to the hypothesis that 
Xi, X2, . , Xk are linearly independent But if ^ 0, it is clearly possible 

to solve Eq ( 3 ) for Xk^ 1 and express it in the form asserted by the theorem 

Because of the property guaranteed by the last theorem, a 
general linear combination of the maximum number of linearly 
independent solution vectors of AX = 0 is usually referred to 

as a complete solution of AX = 0 . 


THEOREM 5 

If Xp is a particular solution vector of the non homogeneous system AX = B 
and if c^Xi 4- C2X2 + ■ ■ -b c^X* is a complete solution of the related homo¬ 

geneous system AX = 0 , then any solution of the nonhomogeneous system can 
be written in the form 

CiXi -b C 2 X 2 -b ■ + CkXk “b Xp 

PROOF Let Xp be a particular solution vector of the nonhomogeneous equa¬ 
tion AX = B and let Xa be any solution vector of this equation. Then AXp = B 
and AXa = and, subtracting these two equations, we have 

AX„ - AXp » 0 or A(Xa - Xp) = 0 

Ifow the last equation shows that X* — Xp is a solution of the homogeneous 
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equation AX = 0, Hence, by Theorem 4 , it can be expressed in the form 
Xa — Xj, = C\X\ -{- c^Xi + ‘ • “h CkXk 

Therefore, transposing, 

Xa = CiXI CiXi + CkXk “h Xp 

Since Xa was any solution vector of the equation AX = B, the theorem is 
established. 

We now turn our attention to the question of when solutions 
of the equation AX = B will actually exist The central result 
IS contained in the following theorem 

THEOREM 6 

A system of m simultaneous linear equations in n unknowns, AX = B, has a 
solution if and only if the cocfTicient matrix A and tin augmented matrix ||A 5 || 
hiive the same rank r When solutions exist, the maximiini number of independent 
arbitrary constants m any general solution, i e , the maximum number of linearly 
independent solution vectors of the related homogeneous system i 4 A^ = 0,is7? — r 

PROOF We shall prove this theorem by applying to the given system 

Ull^l + ai2*T2 -f * ’ “h (llnXn == bi 

^21^1 022^2 "h ' At U2fi2’ = 62 




amn^n ~ 


a procedure, known as the Gauss reduction, which resembles closely the method 
by which wc proved Theorem 7 , Sec 10 4 We begin by assuming that an 5* 0 , 
which IS no specialization, since at least one of the coeflicients in the first equation 
must be dififcrcnt from zero, and, by renaming the unknowns, if necessary, it ean 
be brought into the leading position Next we divide the first equation by an 
and then multiply it in turn by 021, U31, • . , a„.i and subtract it from the second, 

third, . , mth equation This gives the equivalentsystem 


Xi -|- afi 2^2 4 “ 0:133^3 4 " 

4 “ 0 [iaX„ 

= ( 3 i 

022^2 4 “ ^233^3 “T 

4 “ (l 2 n^n 

= &■: 

<^ 82^2 4 " ^ 33^3 4 “ ■ 

’ + OgaXn 

= y. 

+ 

• 4 - a'„„Xa 

= b: 


where, explicitly, 


ai7 « _ 

aij — — ~ 

ail 


= 0x7 - fflti 


Ol, 


K 


= fex - 




h 

flu 


Now we apply the same process to the last m — 1 equations, noting that, if 
®22 = 0, a renaming of the last n — 1 unknowns with possibly a rearrangement 
of the last rn — 1 equations will introduce a nonzero coefficient in place of a^ 
unless all coefficients in the remaining equations are zero, which, of course, may 


* Two equations or systems of equations are said to be equivalent if every 
solution of one is a solution of the other, and conversely 
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be the case at some stage in the process The result of this second reduction is 
the system 

+ aiiXi -h otiiXi -f • • 4. ainXn = / 9 i 

X2 -f ^ 232:3 + ■ ■ + a2„Xn = ^2 

"1 I " l" 

0-38^3 “1 ■ ' ' I — ^3 

ff . I ff 

^48^8 ”1 * I ^AnP^n — ^4 

" I I " 1 " 

®fiia^8 ”1“ ■ ‘ F 

We now continue in exactly the same fashion until the process terminates If 
m < n, this may happen because after m applications there are no more equations 
to which to apply it" 

3^1 "b 012 X 2 4” ai3a^3 “b ‘ + oiimXm + Q!i,m+i3:m+i H“ ' ‘ "b 

3^2 + 0 : 233:3 “b "b 02ma"m + a2,7n+l3:m+1 "b ' “b a2n3’n = 02 

3"a 4 4 aimXm + 03.m4l3:m+l + H“ OttinXn = 03 

Xtn f l3:»n+1 “b OtmnXn 0fn 

On the other hand, regardless of the relative size of m and n, the process may 
terminate because before we have made m reductions, say after only k (<?fi) 
reductions, all coefficients in the left member of each of the remaining n/ - k 
equations are zero 


Xi 4 ai 2 X 2 + ctuXi 4 

-b ctikXk + 

• 4 

4- • 

4 ainXn = 01 

X 2 4 0123 X 9 4 

4 o( 2 kXk 4 

• 4 

+ 

4“ Qf2n3:„ — 02 

X 3 + 

+ askXk 4 - 

+ 

• -b 

4 Oi^fiXfi 03 


+ • + 

4 

• 4- 

+ 


Xk + ' 

• 4 

+ ■ 

4 - CtknXn — 0k 



0 4 

4- ■ 

+ 0 = /3,4 




4- 

-b 




0 4 

• + 0 = 


In the first case, if we transpose all terms containing 3:^42, , 3 ;„, 

we have a system of equations from which Xj„, x^^2> , 3:2, Xi can suc¬ 
cessively be found in terms of 3:^41, 3:,„42, , Xn, which can be given arbitrary 

values. In the second case it may be that 

^*41 0 k -^2 = = 0 m = 0 

so that we have essentially the case we have just discussed, except that now it is 
3:1, I2, . . , Xk which are expressed in terms of the remaining unknowns Xk+i, 

Xk+if . . f Xnj which can be given arbitrary values. If, however, one or more of 
the /S’s after 0k is different from zero, then we have a contradiction, and the 
original system has no solution, or, in other words, is inconsistent. 

Now consider the coefficient matnx and the augmented matrix of the reduced 
system Since the augmented matrix contains the coefficient matrix, it is clear 
that its rank must be at least as great as the rank of the coefficient matnx More¬ 
over, in the solvable cases it is evident from the definition of rank that the rank 
of the augmented matrix cannot exceed the rank of the coefficient matrix and, 
hence, must be equal to it. Likewise, it is obvious that in the inconsistent case 
the Tank of the augmented matrix is actually greater than the rank of the coeffi¬ 
cient matrix. Finally, we observe that the ranks of the coefficient matrix and the 
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augmented matrix for the reduced system are equal to the ranks of the respective 
matrices of the original system, since each step in the Gauss reduction, namely, 
rearranging the columns of unknowns, rearranging the equations, multiplying 
and dividing the equations by nonzero constants, and subtracting multiples of 
one equation from other equations, is an elementary transformation, which, by 
Theorem 2 , Sec. 10 4 , cannot change the rank of either matrix Thus we have 
established the first assertion of the theorem. 

Let us now return to the reduced system in the solvabie case. If r is the com¬ 
mon value of the rank of the coefficient matrix and the augmented matrix, the 
reduced system can be writte.n 

4" 0^12^2 4" aiiXs 4" 4“ airXr = “ ai,r4 — • — ainXn 4" /^l 

X2 4" ^ 232:3 4“ 4“ a2rXr = —a^.r+lXr-^ i ~ — OC^nXn 4" ^3 


Xr = — Ofr,ri-lXr+l ' — CtrnXn 4“ fir 

In this form it is clear that Xr+j, Xr+2, , Xn can be given arbitrary values, say 

Xr+l = Xi, Xr+J = X2, . . , Xn = X^. r 

Substituting these values into the last equation in the above system, we obtain 
Xr immediately. Then, substituting for Xr, Xr4i, , x„ in the next to the last 

equation, we obtain Xr_i, and so on, step by step until each of the x's is determined. 
Finally, when the expressions for Xi, .r2, , Xr are simplified by collecting 

terms on Xi, Xj, . , X„_r we obtain expressions of the form 

Xi = XiCii 4- X 2 C 12 4" 4- \n-rCl,n-r 4“ 7l 


Xr = XiCrl 4 - X2Cr2 4" 

Xr4-1 = Xi 

Xr4-2 — X2 

Xn = 


4 " X«_rCr,n—r 4 “ Ifr 


Xn-r 


X = 


Xr 

Xr+l 

Xt4-2 

Xn, 


= Xi 


Cii 


C 12 



Cl.n-r 


7i 

Crl 


Cr2 



Cr,n—T 


7r 

1 

4" X 2 

0 

4- 

• + X„_r 

0 

-h 

0 

0 


1 



0 


0 

0 


1 0 



1 


0 


The n — r vectors which are multiplied respectively by Xi, X2, . , X„_r depend 

only on the o,/s in the original system and are, m fact, solution vectors of the 
related homogeneous system AX = 0. The vector 


7i 


7r 

0 

0 
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depends not only on the a,/s but also on the h/s and is clearly a particular solution 
of the nonhomogeneous system AX *= B. By Theorem 8, the n — r vectors which 
are multiplied by the \'s are linearly independent. Hence, the related homogeneous 
system AX ^ 0 has n — r linearly independent solutions, and the complete solu¬ 
tion of the nonhomogeneous system AX = B contains n — r independent arbi¬ 
trary constants, as asserted. 


and 


EXAMPLE 3 

Find a complete solution of the system 

Xi 4- -|- Xi — Xi 2xi *■ 2 

xi H" 4 xj + 6x8 ~ 3 x 4 -|- 8x6 " — 2 

— 2xi — X 2 + 4xa — X4 H- 5x8 " —10 

3xi 7xa -}- 5xa — 4x4 “H Oxa “ 4 

Applying the Gauss reduction, we obtain successively 
Xi -f- 2xi -b Xa — X4 -b 2x6 * 2 

2xi -b 4xa — 2x4 + 6 x 5 — —4 

3 xs “b 6xa — 3 x 4 + 9 x 6 * “O 

Xa + 2xa — X 4 "b 3x6 " —2 

Hence, we have the solutions 

Xi * —2xa — Xa -b X4 — 2x6 H- 2 

Xa " — 2x6 + X 4 — 3 x 6 — 2 

Xi - Xj 

X4 X4 

Xa - X6 

or,'taking Xj — Xi, X 4 " Xji xa " X 3 , 

Xi ■■ 3Xi — Xa “b 4Xa -b 6 

Xa ■■ —2Xi “b Xa — 3Xj — 2 

Xi * Xi 
X4 * Xa 

X 6 “ Xa 

A complete solution of the original system is, therefore, 


A" - X, 


ii -b 2xa -b Xa — X4 “b 2x6 ■■ 2 

Xa -b 2xa — X4 + 3X6 - -2 

0 - 0 

0 - 0 


3 


-1 


4 


6 

-2 


1 


-3 


-2 

1 

“b Xa 

0 

+ Xa 

0 

+ 

0 

0 


1 


0 


0 

0 


0 


1 


0 


where Xi, Xa, Xa are arbitrary scalars 

The existence of a solution for the nonhomogeneous system implies that the coefficient 
matrix and the augmented matrix 



1 

2 

1 

-1 

2 



1 

2 

1 

-1 

2 

2 

A - 

1 

4 

5 

-3 

8 

and 

llABll - 

1 

4 

5 

-3 

8 

-2 


-2 

-1 

4 

-1 

6 



-2 

-1 

4 

-1 

5 

-10 


8 

7 

6 

-4 

0 



3 

7 

5 

-4 

0 

4 
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have the aame rank. The fact that the complete solution contains three arbitrary constants 
implies that the common value of the rank of the two matrices is 2, since, accordinR to the last 
theorem, 

(Number of arbitrary constants in complete solution) 

=* (number of unknowns) — (common value of rank) 


It IS, of course, not difficult to verify that A and 1|X/?11 are l>oth of rank 2 The vector 




6 

-2 

0 

0 

0 


IS a particular solution of the Riven nonhomoRoneous equation A X B The vectors 


3 


-1 


4 

-2 


1 


-3 

1 

A% - 

0 

and A, « 

0 

0 


1 


0 

0 

i 

0 

i 

1 


are tliree linearly independent solutions of the related homoReneous equation AX * 0 That 
+ XzA'z d- Xi.Va -f Xp IS a complete solution of the Riven system follows, of course, from 
Theorem G 


As the last example illustrated, the dauss reduction provides 
a practical method for solving systems of simultaneous linear 
puitions in the general case However, in several important 
special cases Hiere are oilier methods which are sometimes more 
convenient SpiTifically, we have the following pair of theorems 


THEOREM 7 (CRAMER’S RULE) 

If the coofTicient matrix A of a system AX = B of n linear equations in n un¬ 
knowns is nonsiiigular, the system has the unique solution 


X, 


_ l^>il 
~ Ml’ 


_ 

" Ml’ 


Xn 


_ |/)n| 

~ Ml 


where 7), is the matrix obtained from A by replacing the zth column of A by the 
column vector B. 


PROOF Since the matrix of coefficients A is nonsingular by hypothesis, it 
follows that its inverse A ^ exists Hence, prcmultiplying the given equation 
AX — 5 by A h we obtain 

X - A-'B 

and direct substitution confirms that this actually is a solution Now, m the 
column vector A'^B, the element m the ?th row is simply the scalar product of 
Ihc ?th row vector of A“‘ and B itself, that is, 

A 1,61 -f" A 2 %bi "h ■ ”1“ Anibn 

^ M^ 

Moreover, the numerator of this fraction is just the expansion, in terms of the 
7 th column, of the determinant of the matrix Z>» obtained from A by replacing 
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the ith column of A by the column vector B. Hence 


(4) 



as asserted 


Since A is nonsingular, the rank of the coefficient matrix and the rank of the 
augmented matnx are both equal to n Hence, according to Theorem 6, there 
can be no arbitrary constant in any complete solution, and the solution we have 
found is the only one. 


If in the (n,n) system AX B the vector B is zero, that is, 
if hi = 62 = ■ * • = h» = 0, then, clearly, each determinant 
\Dt\ contains a column consisting entirely of zeros and hence is 
zero. If 1^1 ^ 0, it therefore follows from ( 4 ) that = 0 for all 
values of t, or, in other words, that only a trivial solution is 
possible On the other hand, \{ B = 0 , the coefficient matrix and 
the augmented matrix have the same rank, and if |i4| =0 the 
common value of these ranks is at most r = n — 1; that is, 
r ^ n ~ 1 Hence n — ns at least as much as 1, and, by Theorem 
6, the equation AX = 0 has at least one nontrivial solution 
vector Thus we have established the following important 
corollary of Theorem 7 . 


COROLLARY 1 

A homogeneous system of n linear equations in n unknowns AX = 0 has a non¬ 
trivial solution, 1 e , a solution other than Xi ~ X2 = = = 0, if and only 

if the determinant of the coefficients |i 4 | is equal to zero 

More specifically, when the rank of the coefficient matrix 
of a homogeneous system of n linear equations m n unknowns is 
n — 1, we have the following useful result • 


THEOREM 8 

If the coefficient matrix of a homogeneous system of n linear equations m n 
unknowns AX = 0 is of rank n — 1 and if the submatrix obtained from A by 
omitting the kth row is also of rank n — 1, then a complete solution of the given 
system is 

X* = cAjfc. t = 1, 2, ,71 

where c is an arbitrary constant. 

PROOF Since the rank of the (n — 1, n) matrix remaining when the kih row 
is deleted from A is n — 1, it follows that at least one of the cofactors A*, of the 
kth row is different from zero. Hence, not all of the values x, = cA*. are zero 
To verify that these values do indeed satisfy AX = 0 , we need only substitute 
them into the general equation of the system, namely, 

n 

5) = 0 j = 1, 2, . . . , 71 

t-1 

and verify that it is satisfied. Doing this, and using Corollary 1 , Theorem 11 , 
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Sec. 10 1 , to simplify the result, we have 


V djticAki) ■” c ^ o,JlA^c^ 


j 9^ k 
j = k 


Thus, since |. 4 | = 0 , by hypothesis, it follows that each equation is satisfied by 
the given values Finally, since the rank of both the coefficient matrix and the 
augmented matrix is r = n — 1, it follows by Theorem 7 that the system has 
just one independent solution vector Hence the solution given by tin' formula 
of the theorem is a complete solution, as asserted 


EXAMPLE 4 

Find a complete solution of the system 

xi — 2x2 + xa + 3x4 = 0 

2x\ + 2x3 ■- Xa H- J 4 0 

— xi — Xj -|- 3xs + 2x4 =• 0 

Xi — 8x2 — ij + 3x4 =* 0 

t 

It 18 easy to verify that the determinant of the coedu ientH of this system, 1.4 |,jis zero but that 
the determinant of the (3,3) submatnx in the upper i(‘ft hand corner of A is different from zero 
Thus the coefficient matrix A and tfie submatnx remaining when the last row is deleted from A 
are botli of rank 3 Hence, according to the last theorem, the values of x which satisfy the given 
system of equations are proportional to the cofactorB of the last row in 1.41 Thus we have 


-2 

1 

3 

1 

1 

3 

— c 2 

-1 

] 

=» 20 c X 2 — c 2 

-1 

1 - -5f 

-1 

3 

2 

-1 

3 

2 

1 1 

-2 

3 

1 

-2 

1 1 

Xj * c 2 

2 

1 

- 15c X 4 « -c 2 

2 

-1 - 15c 

--1 

-1 

2 

-1 

-1 

3 

or, setting 5c — k, 






xi ■= 4/r 

X2 - 

-k 

Xa “Sir X4 




In view of Theorems 7 and 8, it is clearly desirable to have 
some convenient cnterion for determining when a determinant 
IS different from zero. One useful one is provided by the following 
theorem, whose proof is an mteresting application of Corollary 
1 , Theorem 7 


theorem 9 

If in each row of a determinant the absolute value of the element on the principal 
diagonal is greater than the sum of the absolute values of the remaining elements 
m that row, the value of the determinant is different from zero 

PROOF Let |i4| be an n X n determinant m which, for each value of 
( 5 ) |a„l > I |a„|t 


t This property of the absolute values of the elements of a determinant is 
Imown as diagonal dominance and is quite important in the solution of 
systoms of Imear equations by iterative methods. 
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To prove that \A | is not equal to zero, let us assume the contrary. Now, if 1-41 = o, 
then by Corollary 1, Theorem 7 , the equations 


( 6 ) 


diiXi + auXi -f- ■ ■ ’ "b dinXn = 0 


OnlXi -f- an2X2 “h * + = 0 


have a nontrivial solution Let x* be the component of maximum absolute value 
of such a solution vector. Then from the fcth equation of the system (6) we have, 
by transposing, 

n 

akkXk = 

j-i 

Jf^k 

Hence, taking absolute values, 


\akk\ |x*| g 2 M = Z ■ 1^*1 


j-i 

JW^k 


J-1 

jf^k 


and therefore, dividing out |x*|. 


la**| ^ £ |ok,l 


j-i 
J f*k 


But this contradicts some one of the inequalities (5), which hold, by hypothesis 
Therefore we must abandon the assumption that 14 | = 0, and the theorem is 
established 

If a set of vectors has the property that it contains at least 
one subset of r vectors which are linearly independent, but all 
r -h 1 vectors are linearly dependent, the set is said to be of 
dimension r. Using Theorem 6, it is not difficult to prove the 
following theorem about the dimension of a set of vectors: 


THEOREM 10 

A set of row (column) vectors Xi, Xj, . . , X„ is of dimension r if and only if 

the matrix 


Xi 

X2 


II X. 

is of rank r. 


(lIXiX, • ’ X„||) 


COROLLARY 1 

If Xi, X2, . . . , X„ aren linearly independent vectors each having n compo¬ 
nents, then any vector B with n components can be expressed as a linear com¬ 
bination of the X's. 

In Sec. 10.4 we observed that what we called simply the 
rank of a matrix is sometimes referred to as the determinant 
rank. This permits one to distinguish between the rank, as we 
defined it, and the row rank and column rank, which are, by 
definition, the maximum number of linearly independent row 
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and column vectors, respectively, in the matrix. However, the 
necessity for distinguishing between the three definitions of 
rank is eliminated by the following theorem, whose proof follows 
immediately from Theorem 10: 

theorem 11 

For any matrix A, the determinant rank, the row rank, and the column rank 
are all equal. 

Another interesting consequence of Theorem 10 is ( ">ntained 
in the following theorem ■ 

THEOREM 12 

If A and B are conformable matrices of rank r and p, respectively, the rank of 
the product AB is equal to or less than the smaller of the numbers r and p. 

PROOF Let A be an (m,p) matrix, let B he a. (p,n) matrix, and let the rows 
of A be A], A2, , , Am Then ihe ith row vector in the product AB (see 

Exercise 7, Sec 10 2 ) is 

( 7 ) A,B 

Now, by hypothesis, the rank of A is r Hence, by Theorem 10 , A contains exactly 
r linearly independent row vectors, which, without loss of generality, we can 
take to be the first r, namely, Ai, A2, . , Ar Hence, for 7 = r + 1 , r 4 - 2 , 

, Wf the ro A, must be expressible as a linear combination of the first r 

rows • 

A, = Xi,Ai 4 XztAa 4 - • 4 - Xr,Ar i = r 4 1 , r 4 - 2 , . . , m 

Therefore, substituting into ( 7 ), wc find that, for 7 = 7 -b 1, r 4- 2 , • , 

the 7 th row vector of the product AB is 

(Xi,Ai -f- X 2 ,A 2 4 4 XriAr)B = XjjAjB + X 2 tA 2 B 4 " \r\ArB 

Bui- this shows that each row of A B after the rth is a linear combination of the 
first r rows, which, in turn, proves that AB contains at most r linearly independent 
row vectors and, hence, is of rank at most r A similar argument, using a column 
partition of B, shows that the rank of AB is at most equal to p. Therefore, the 
rank of AB is at most equal to the smaller of the numbers r and p, as asserted 
If A and B are also conformable in the order BA, it is clear that the rank of BA 
IS also equal to or less than the smaller of the pair (r,p). 

The estimate for the rank of the product AB provided by 
the last theorem can be supplemented with the following result * 

theorem 13 

If A 18 an (w,p) matrix of rank r and if B is a (p,n) matrix of rank p, the rank 
of the product AB is equal to or greater than r + p — p. 


* Both thifl result and Theorem 12 are due to the English mathematician 
J J Sylvester ( 1814 - 1897 ) and are known together as Sj^lvester's law of 
nullity. A proof of Theorem 13 can be found in L. Mirsky, "Linear Algebra,” 
p. 162 , Oxford ^ok Company, Inc., New York, 1956 . 
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As we shall see in later sections, a set of vectors is usually 
much more convenient to work with if the vectors, in addition to 
being linearly independent, are also orthononnal, that is, are of 
unit length and mutually orthogonal. A general set of r linearly 
independent vectors will ordinarily not possess the property of 
orthonormality, but, by an important procedure known as the 
Schmidt orthogonalization process, it is always possible to 
determine linear combinations of r linearly independent vectors 
which will be orthonormal as well as independent. Let Vi, Vj, 
, Fn be n linearly independent vectors, and let us choose 
any one of them, say V i, and reduce it to a unit vector by divid¬ 
ing it by its length y/Vi'^Vi This gives us the first vector of our 
orthonormal set 

We now choose any member of the original set except Fi, say 
F2, and write 

TF2 = F2 - CiUi 

where Ci is a constant to be determined so that TF2 is orthogonal 
to ll 1 This, of course, requires that 

- c,i\) = 0 

From this, since = 1 , we have 

Cl = tZ/Fj and W* - F^ - (C7i^F2)f/i 

We now convert IF2 to a unit vector by dividing it by its length, 
getting 

^_ ^ ___ 

VW^Wi V{v, - 

Next we choose any member of the original set except Fi and 
F2, say Fj, and write 

W, = F, - djii - 

where di and 0^2 are constants to be determined so that PFa will 
be orthogonal to both U\ and Vi. This gives us the two conditions 

f/i^Wa = f7i^(F3 - dit/i - d.U^) = f//F3 - di = 0 
= f/ 2 ^(F 3 - dit/i - diU^) = - d, = 0 

Hence, 

di = rZ/Fa and d^ = 


and, therefore, 

W 3 F, - (f/i’’F3)t7i - (f/ 2 ^F,)f/, 
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Wz is now normalized, giving us our third unit vector Us; and 
the process is continued until the required set of orthonormal 
vectors is obtained from the original set. It is clear that the 
process can fail if and only if at some stage 

W,= Vt- Y (U/Vft)U. = 0 
1-1 

However, if Wt = 0 , this implies that 

V, = Y 
1-1 

which, replacing the C/’s by their expressions in terms of Vu Vt, 

, Vk-u implies that Vk is either zero or else a linear com¬ 
bination of the preceding F’s Each of these contradicts the 
hypothesis that the V’b are linearly independent, and hence 
cannot happen An almost identical argument (or the result of 
Exercise 14 ) shows that the C/’s derived by the Schmidt process 
aie linearly independent. 

EXERCISES 

1 Verify that sin x and cos x are linearly independent 

2 Are cos’ t, am* x, and cos 2x linearly independent? Why? 

8 Show that, i > is included in a set of quantities, the members of the set are always linearly 
dependent 

i Show that, if the quantities Qi, Qi, , Qn are linearly independent, the members of every 
subset of the Q’s are also linearly independent Is the converse true? 

6 If is a square matrix and if the equation AX = 0 has k linearly independent solution 
vectors, show that the same is true of the system — 0 Is this result true if A is not a 

square matrix? 

6 Show that five or more 2X2 matrices arc always linearly dependent How many 3X3 
matrices must we have before we can be sure they are linearly dependent? Why? 

7 Verify that the vectors 

1 12-1 
Xi = 1 Vj = -1 A., » 1 A 4 - 4 

0 1 3 -5 

are linearly dependent, and express each of the vectors as a linear combination of the other 
three. 

8 What conditions must a, b, c, and d satisfy in order that the matrices 

la h 

and , be Imearly dependent? 

II c a 

9 Using the Gauss reduction, find a complete solution of each of the following systems 

a ari + 2 x 2 + — xt 2Xi “3 b a:, + -f ij — X 4 — it *" 2 

3ii -h 4ii + 5ij — J4 — 2 j5 = 7 11 + 2ia + 4ii — X 4 -h fiit “ 3 

Xi -h 3xa H- 4x3 A- 6 x 4 — xt ” 4 3ii -1- 4xa 4- 5xi — X 4 — 2 x 5 “ 7 

xi At 3x 2 -h 4 xj -h 6 x 4 — xt “ 4 

2 xi A- 5x2 + 8 x 3 + 4x4 + xj “ 7 

xi — Xi — 2xi — 7x4 — xt " 0 
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10 Using Cramer’s rule, solve each of the following systems- 

A asi — + 2x, - —6 h xi — xa -h 2xa + 2:4 - —6 

—Xi 4- ■■ 0 —ii + Sii + 2*4 * 0 

2xi -h xa - 1 2xi + X* - X4 - 1 

2xi -}- 2zi + ii -H 3x4 " — 1 

11 Using Theorem 8, solve each of the following systems ■ 

A xi - 2xt + 3xi - 0 b xi - 2xi -}- xi - 3x4 - 0 

2xi -h 3x2 — Xi " 0 2xi + X 2 — 3xj + X 4 " 0 

4xi — Ii -f" 5ii " 0 3xi + 3xf — 2xi -j- X4 * 0 

12 Determine the values of X, if any, for which each of the following systems has a nontrivial 
solution, and find such solutions when they exist. 

A Xxi — 2xi + xi — 0 b (6 — X)ji + 4xi — 2xi — 0 

Xxi + (1 — X)xj + xi — 0 4xi + (6 — X)xi — 2xj -« 0 

2xi — Xi + 2Xxi — 0 — 2ji — 2xi + (3 — 2X)xi « 0 

18 If the rows of a matrix are linearly dependent, are the columns necessarily linearly dependent? 
14 Show that, if the vectors of a set arc mutually orthogonal, they are linearly independent 

16 Show that, if r is the maximum number of linearly independent quantities m the set 

Qi, Qa, . , Qm and if Qi, Q", , Qr arc linearly independent, then ^,+1, Qr-n, ■ , Qn 

can each be expressed as a linear combination of Qi, Qi, , Qr. 

10 If the quantities Qi, Qf, , Qn are such that Qr+i, Qr+i, , Qn can each be expressed 
as a linear combination of Qi, Qi, , Q,, show that at most r of the Q’s can be linearly 
independent. 

17 Show that any (3,4) matrix of rank 2 can be written as the product of a (3,2) matrix of rank 
2 and a (2,4) matrix of rank 2 Of what general theorem do you think this is a special case? 

18 Prove Theo^’cm 10. 

19 Prove Corollary 1, Theorem 10. 

20 Using the Schmidt process, construct a set of orthonormal vectors from the vectors in each 
of the following seta 


• V'. - 111,2,211 

0 

1 

V. - 112,0,111 

b r. - 111 , 1,011 

V. - 111,0,111 

V. - 110,1,111 

e r. - 111,1,1,111 

V, - 110,1,2,211 

V, - 110,0,1,111 


21 Prove that, if an (n,n + 1) matrix A contains a column of elements which are not all zero 
and if every nth-order determinant in A which contains this column vanishes, then the rank 
of A 18 less than n (Hint Expand each of the vanishing determinants in terms of the ele¬ 
ments in their common column, consider the determinant of the resulting system of equa¬ 
tions, and use the result of Exercise 8, Sec 10 3.) 

22 Prove that n vectors Vi, Va, , Vn are linearly dependent if and only if the so-called 

Oram determinant, or Gramian, 

VJV, VJVa ■ ■ 

Va^Vi Va^Va ■ ■ • Va^Vn . , , 

IS equal to zero 

V^^Vi Vn^Va Vn^Vn 

18 If .4 is a square matrix, p a positive integer, and X a vector such that Af^X ^ 0 but 
A^'^'^X — 0, show that the vectors X, AX, A*X, . , A^X are linearly independent 
• Let A and B be matrices conformable in the order AB. Prove that the rank of 45 is 
equal to the rank of B if and only if BX — O for every vector X such that ABX -• 0. 
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b If ^ ia a square matrix and if p is a positive integer such that and 4have the same 
rank r, show that vl *’■*'*, , also are of rank r 

20 Prove that, if A is an (n,n) matrix, then ^. all have the same rank 


10.6 

Metric differential equations 

In Sec. 3.3 we saw that the ideas of complementary function and 
particular integral which we developed for single linear differen¬ 
tial equations could easily be extended to systems of linear 
differential equations. This analogy is especially striking when 
we regard a system of linear differential eijuations with constant 
coefficients as a single matnc equation, much as we regarded a 
system of linear algebraic equations as a single matnc equation 
in the last section Moreover, the procedure for handling systems 
of equations when the characteristic equation has repeated or 
complex roots or when a term on the right-hand side duplicates 
a term in the complementary function is best described in the 
language of matrices. Hence we shall conclude this chapter with a 
brief discussion of matnc differential equations. 

Let the system we are given be 

Pll{D)Xi + Pi2{D)x2 + -f Pin{D)Xn = fi{t) 

Pi\{D)Xi + P22{D)X2 -f ’ + P2n(D)Xn = ^(0 


Pnl{D)Xl -h Pn2{D)Xl + ' + Pnn{D)Xn = /n (0 

where the p^/s arc polynomials in the operator D with constant 
coefficients If we define the matrices 


Pu{D) 

PidD) 

Pii{D) 

P22(^) 

Plr,(D) 

PldD) 

1 

X = 

•Cl 

X2 

Fit) = 

/.(O 

fdt) 

P.dD) 

PndD) 

■ ■ pum 


Xn 


hit) 


the system (1) can be written in the compact form 

(2) P(D)X = Fit) 

The associated homogeneous equation is, of course, 

(3) PiD)X = 0 

The first step in finding the complementary function of 
Eq. (2) IS to assume that solutions of Eq (3) exist in the form 

X = Ae”** 

where the scalar m and the column matrix of constants A have 
yet to be determined. [The expres.sions 

X ae"** y = be^ z = ce"** 
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in Eq. (3), Sec. 3 3, arc, of course, just the scalar form of this 
assumption for the special case n = 3.] Since 

it follows that, if we substitute the vector X = into the 
homogeneous equation (3), we obtain just 

P(rn)Ae'^ — 0 

or, dividing out the nonvanishing scalar factor 

(4) P{m)A = 0 

This IS the inatric. equivalent of the algebraic system in Eq. (4), 
Sec. 3 3, which we obtained in our scalar treatment of the specific 
system of differential equations we considered in that section 
Now by Corollary 1, Theorem 7, Sec. lO.o, Eq (4) will have a 
nontrivial solution if and only if 

(5) lP(m)l = 0 

and for cacti root rrij of this equation there will be a solution vector 
Aj of (4) d(‘ternnned to within an arbitrary scalar factor kj If the 
characteristic equation (5) is of degree N and if its roots [rrij] are 
all distinct, a complete solution of Eq (3)—and the comple¬ 
mentary function of Eq (2)—is then 

X = /ciAie*"*' H- + • -h 

This we recognize as the inatric equivalent of the scalar system 
(9), Sec. 3 3, with AT = 3 and 


II 

-1 

2 

II 

3 

-1 

II 

9 

-6 


-1 

! 

-1 


-1 


As in the case of a single .scalar differential equation, if the 
set of roots includes one or more pairs of conjugate complex 
roots, it IS desirable to reduce the corresponding complex expo¬ 
nential solution to a purely real form To see how this can be 
accomplished, let p ± iq be a pair of conjugate complex roots 
of E(i (5), and let A be a particular solution vector of (4) cor- 
re.spoiiding to the root m = j) iq, that is, let 

P{m)A = P(p -h iq)A = 0 

Then, since all the coefficients in (4) are real, it follows by taking 
conjugates throughout the system that 

P{m)A s P(p — iq)A = 0 

Thus A is a solution vector corresponding to the conjugate root 
m = p — iq 

and, therefore, we have the two particular solutions of Eq. (3), 
and 
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By combining those as follows and applying the Euler formulas, 
we obtain two independent real solutions 

^ /A A , A - A \ 

-^ - = eP' (-- - cos Q( - ---— Mil qtj 

(fifl) ^ eP'[(R(.4) eos qt — {f(A) sin qt] 

^p(p-Tig)t _ ^p(,. 1«)( / ^ 4 -f .4 

- ——- — = pos ql H- - “;y — Sin qt 

(6/)) == e^^\^(A) cos qt + (R(4) sin qt] 

where 6t(4) and &{A) denote the column n'lifnees whose compo¬ 
nents are, respectively, the real parts of the components of A 
and the imaginary parts of the components ot A In many cases 
this method of determining the necessari relations among the 
coefTieients of solutions of (It) of the foim 

Xj ~ eos qt f- h, sm qt) 

IS simpler than tin* alternaiive process of substituting these 
expressions into the original differential (aiuations, collecting 
terms, and eipiating tli(‘ lesulting coefficients to zero. 

If |/^(??0l = 0 double root, say in = r, we proceed 

very much as in the case ol a single differential equation. If A 
IS a solution of the e([uation P{r)A •- 0, then, of course, 

Ae*-' 

IS one solution of (3) Ifowi'ver, as a second independent solut’rn 
we must tiy not /i/c’"', as strict analogy vMtli the scalar case would 
suggest, but rather 

(7) 4 ^2C^' 

The term Bie^^ must be ret.vined in the matric case because m 
general the matrix Hg will not be a scalar multiple of 4, and hence, 
in constructing the complete solution, th(‘ term cannot be 

absorbed in the term 4c’^^ as is necessarily the ease for a single 
scalar differential e(]uat.ion It can be* shown, however, that to 
within an arbitrary scalai factor the matrix Bi is the same as A. 
Hence, after (7) has been substituted into the homogeneous sys¬ 
tem (,3), it IS only necessary to solve for llie ratios of the compo¬ 
nents of the matrix B 2 Similar observations hold for roots of (5) 
of higher multiplicity Thus, for a A'-fold rool^ r, the appropriate 
solutions are not 4c^‘, Bte^\ , /v/* but rather 

Ae^* 

4 - BieP 

Kvi^ 4 - Kit^ + 4 - Kke^^ 

In this ease, to within arbitrary scalar factors, the matrices 
4, Bi, , A'l are identical. 
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EXAMPLE 1 

Find a complete solution of the system 

(D* 4- Z) + S)Xi + (D* + 6D + 3)x3 - 0 
(/) 4- l)xi 4- (D* + l)i3 “ 0 

In this case the characteristic equation (5) is 

I (m» + m 4- 8) (7n> 4- 6m + 3) ^ 

I (m 4- 1) (m^ + 1) 

with roots 1, 1, —1 ± 2t For the root —1 4- 2t, Eq (4) becomes 


m* -b 2m^ — 8m 4- 5 " 0 


(-1 +2t)’ + (-1 +2.) +8 

(-1 +2t)‘ + 6(- 

1 -f 27) -b 3 


(-1 +2i) + 1 

(-1 + 2»)‘ 

' + 1 

02 0 1 


(4 - 2i) (-6 +8i) a, _ 10 
II 2i (-2 - 4i) II II aall " || 0 |1 

This 18 equivalent to the two scalar equations 

(4 - 2t)ai 4 (-6 -i 8 i)o 2 - 0 
2 iai — (2 4- 4t)a2 “ 0 

Since m ■» —1 4- 2t is a root of the characteristic equation (5), these two equations are depend¬ 
ent, and the ratio of oj to oj can be found equally well from either of them Using the second, 
Since it 18 a little simpler, we therefore have 

Oi 1 4" 27 Ul 1+27 

— —-or 4 0 . 

Qj 7 a2 * 


Hence, dl(4) “ j| q || ^ || j 

and thus from (6) we have the two particular solutions 


(I -| 1 


cos 2i -f ^ Bin 2t) 


For the repealed root m *» J, we have one solution of the form Z?e‘, where, from (4), 

11^0 ^oll II I! “ II !!ll so we can lake /I ® II ?'II “ II ! Il 


As a second solution we have, from (7), 

Cite* 4" Cjc* 

or, since Ci — B (as we observed above, without proof), 


Substituting this into the original system, we obtain two equations, each of which reduces to 
2ci2 -}- 2cj2 ■■ 1 
Hence we can take* 

Cii - 0 and caa - H 

The solutions associated with the double root m ■= 1 are, therefore, 

jf.-IL}L- »nd jf.-ll !ll»«‘+||,?IU 


•The most general choice, cia - X, Cai “ (1 — 2X)/2, leads to the same 
expression for Xt plus a matrix proportional to Xt which can be combined 
with A'a when the complete solution is constructed. 
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or, m scalar form, 

Xt “ 2A:j) cos 2t — (2fci — ^ 2 ) sm 2 ^J -|- -h kde* 

Xt “ e“‘[A:i cos 2t — hi am 2l] — (iti — 

To find a particular integral of the nonhomogeiit.ous system 
(2), we proceed very much as in the case of a single scalar equa¬ 
tion In fact, for vectors F{t) which have only a finite number of 
independent derivatives and which do not duplicate vectors 
already in the complementary function, the results of Table 2.2, 
Sec 2 3, can be used without change, provided only that the 
arbitrary scalar constants appearing in the entries in the table be 
replaced by arbitraiy constant vectors The trial solutions are 
then substituted into the nonhomogeneous system, and the 
arbitrary components of the coeflicicnt vectors are determined 
to make the resulting ecpiations idi'iiticaily true. The only sig¬ 
nificant difference between the scalar case and the matric case 
IS that in tlie latter, when duplication occurs between a vector 
on the right of (2) and a vector in the complementary function, 
not only must the usual choice for a particular integral be multi- 
nlied by the lowest positive integral power of the independent 
vaiiable wliich will eliminate the duplication but the products of 
the normal choice and all lower nonnegative integral powers of 
the independent variable must also be included in the actual 
choice 


EXERCISES 

Find a complete solution of each of the following systems’ 


1 (D -f 5)a: -h (D + 7)y = 2c‘ 
(2D + 1)1 + (:iD + 1)1/ = 

3 (D + l)x + (D + 2)v = 

(3D + Dx + (4D + 7 ) 7 / = -7r^ 

6 (2D + \)x + (D -f 2)i/ » 1 

(D + 2)x + (D + 4 )1/ - 2 

7 (2D + l)j + (D + 2)y = 

(3D - 7)x + (3D + l)y - 0 


2 (D + 2)x -h (D + 3)y « 2f + 4 

(2D - (i)x + (3D - 4)v - -6< - 2 

4 (D + l)x + (D + 2)y-i + 1 

(5D + l)i + (6D + 3)y - -2« + 1 
6 (D + l)x + (4D - 2)v - c-‘ 

(T) + 2)x + (5D - 2)y - c ' 

8 (2D + 1)1 + (D + 2)y - sm ( 

(3D + l)x + (3D + 5)y - cos I 


9 Show that D’^(te”*‘) — Hence show that 

p(D)te'^ ■■ p{m)t€'^^ + p'Cw)®"’' 
and PiD)t€”'* » P{m)i€”'^ + P'im)e"** 


where p(D) is a polynomial in the operator D and P{D) is a matrix whose elements are 
polynomials in D 

10 Using the results of Exercise 9, show that, if mi is a double root of the characteristic equa¬ 
tion |P(m)| — 0 and if Xi - is one solution of the system P(D)X — 0, the coeffi¬ 
cients in the second independent solution Jf* - Difc"**' + satisfy the equations 

Pirni)Bi - 0 and P(m,)J 82 + P'imi)Bi - O. 
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Quadratic fonns 


In this section we shall continue our study of matrices by intro¬ 
ducing tlie important mathematical objects known as qundiahr 
forms, hennilian forms, and bilinear forms' 

By a quadratic form we mean a homogeneous second-degree 
expression in n variables of the form 

Q(jr) = -f 2012^-1^:2 + -F 2 ai„j:ia:n 
+ 2022X2^ -F -F 2 a 2 nX 2 Xn 

-F + • • • 

+ a„nXn^ 

Usually the cross products are separated into two equal terms, 
and the whole expression is written in the more symmetric lomi 

Q{x) = -F 012X1X2 -F + ainXiXn 

-F 021X2^1 -F 022X2^ + + a 2 nX 2 Xn 

-F. 

+ aniXnXv + an2XnX2 + + dnnXn^ 

wliere now, of course, a^, = If a quadratic form with real 
coefficients has the property that it is equal to or greatei than 
(equal to or less than) zero for all real values of its variables, it is 
said to be positive (negative). A positive (negative) form whicli 
IS zero only for the values Xi -- X 2 = ■ = c,, = 0 is said to be 

positive-definite (negative-definite). Positive-definite and nega¬ 
tive-definite forms are sometimes referred to collectively siiniilv 
as definite forms A jiositive (negative) form which is zero foi real 
values other than Xi = xa — • • = x„ = 0 is said to be 

positive-semidefinite (negative-semidefinite). A real quadratic 
form which can take on both positive and negative values is said 
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iiO be indefinite. Examples of quadratic forms of each type are 
shown in the following table: 


tabu n.i 


Type of quadratic form 

Example 

Positive-definite 

3-1^ + Xl’ 

Negative-defin’te 


PoBitive-semidefinite 

{xi - Jj)' 

Negative-soinidefinitc 

— (j-i - OTi)^ 

Indefinite 

— Xi® 


If we define the matrices 


Xi 



an 

an 

Oln 


and 

A = 

Qi, 

022 

a-ln 

Xn 

1 


ilnl 

a„2 

ann 


q IS clear from the definition of matric multiplication that the 
quadratic form (1) can be written in the compact form 

(2) Q(x) = X'^AX A symmetric 

In this notation .1 is called the matrix of the quadratic form and 
is said to be positive- or negative-definite, semidefinite, or 
indefinite according to the nature of m turn, la 

said to he singular or nonsingular according as A is singular or 
nonsingular, that is, iK'cording as |.4| is oi^ual to zero or different 
from zero 

If a (juiidratK* form is dcfini1(‘, it is necessarily nonsiiigular, 
for we can write 

Q(x) = (fliiJi -h ■ "h (iu^n)JCi 

-h {oiiXi H- -f a2r,rn)x7 

+ 

“j- ^nnXn^XT^ 

and, if we suppose that |i4l = 0, then the system of equations 
obtained by equating to zero the expressions in parentheses has a 
nontrivial solution (('orollary 1, Theorem 7, Sec 10 5), and for 
these values Q(x) is obviously equal to zero, contrary to the 
hypothesis tliat it is definite The eon verse of this observation 
is not true, however; that is, a nonsingular quadratic form is not 
necessarily definite For instance, the form 

Xi® — 2 XiX 2 + 2x2^ — X3^ 
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is nonsingular, since the determinant of its matrix, 


1 -1 0 
-12 0 
0 0-1 


= -1 


IS different from zero; yet it is not definite, since it is equal to 
zero for the nontrivial values xi = 1 , 3-2 = 0 , Xs = 1 The com¬ 
plete criterion for the definiteness of a quadratic form is contained 
in the following theorem, for w^hose proof we must refer to texts 
on higher algebra * 


HEOREM 1 

A necessary and sufficient condition that the real quadratic form X'^AX he 
positive-definite (negative-definite) is that the quantities 




flu 

012 

021 

O 22 


Oil 

O12 

Oi 3 

O21 

O22 

O23 

O31 

O32 

O33 


ail (Jin 

ani a,i„ 


all be positive (alternate in sign, with an negative) 


(ffearly, equivalent sets of necessary and sufficient conditions 
can be obtained by first permuting the vaiiables and then apply¬ 
ing Theorem 1 This gives us the following somewhat more genend 
theorems’ 


THEOREM 2 

A necessary and sufficient condition that the real quadratic form X'^AX hv’ 
positive-definite is that every principal minor of A be positive 

THEOREM 3 

A necessary and sufficient condition that the real quadratic form .V lx* 
negative-definite is that every principal minor of A of odd order be negative and 
every principal minor of A ot even order be positive 


EXAMPLE 1 


The quadrat ir form 


J 3 II 


1 2 -2 


Xi 

2 5 -4 


3-2 

-2 -4 5 


Xi 


Tl^ -t- 2 X 1 X 2 — 2XiX3 

“f2x2Ji + 5x2^ — 

— 2 xiJi — 4x3X2 “f .‘">Xj* 


IB poRitivt'-dcfiiiitc, BiiK (' the three (juantities 
1 and 


1 1 2| 


1 

2 

-2 

I 2 s " ^ 

and 

2 

5 

-4 



-2 

-4 

5 


arc all positive In fact, the quadratic form ran be written equivalently as 
(j, ~h 2X2 - 2 x 3 )’ -h Xj^ -f Xa* 


* See, for instance, W L. Ferrar, “Algebra,” pp 138-141, Oxford Hook 
Company, Inc , New York, 1941 




SEC. H.l 


QUAMATIC FORMS 


469 


which, being a sum of squares, can vanish only if 

ail 4- 2x2 — 2a:a - 0 and arj - 0 and jj - 0 


and these, in turn, can hold simultaneously only if a-i ■» j* »» a:j — 0 
On the other hand, the quadratic form 


1 2 -2 


Xi 

2 3-4 


Xj 

-2 -4 5 


x> 


iH not definite, since the three quantities 


ii* 4- 2xiX 2 — 2x,xs 

+2rij:i -f :ixj’ - 4 xjX8 
— 2jjJi — 4a:iXj ' 5ia* 


1 1 2| 


1 

2 

-2 1 

2 3 I ~ * 

and 

2 

3 

-4 « -1 


1 

! --2 

-4 

5 


do not fulfill either of the conditions of ''I’luHirein I In fact, this quadiatic form can be written 
as (jTi 4-2x 2 — 2xj)* — X 2 * + Xj*, and, since this cxpic8s»on take« (di the value 1 when x^ “■ 2, 
ij = n, xa “ 1 and takes on the value — 1 when Xi = — 2, Tt •* 0, it is actually indefinite 


In our definition of a quadratic form, neither the matrix of 
coefficients A nor the matrix of unknowns X was restricted to 
be real However, in most elementaiy applications both A and X 
Will bo real, and only for real quadratic forms are such jiroperties 
ae definiteness and indefiniteness defined Actually, when com¬ 
plex quantities are involved, (piadratic forms, as we have defined 
them, are almost alwavs replaced by related expressions known as 
hermitian forms: 


DEFINITION 1 

If A IS a hermitian matrix, the expres.sion X'^AX is known as a hermitian form 

Recalling the definition of a hennitian matrix (See 10 2) it is 
easy to verify that any hermitian form is equal to its transposed 
conjugate Moreover, since it is a scalar, ie, a (1,1) matrix, it 
IS also equal to its transpose Hence, we have the following result’ 


theorem 4 

The value of a hermitian form is real for all values of its variables 

Because of Theorem 4, positive- and negative-definite, positive- 
and negativp-semidefinite, and indefinite hermitian forms can be 
defined precisely as the corresponding types of quadratic forms 
were defined Moreover, it can be shown that the criteria for 
definiteness contained in Theorems 1, 2, and 3 hold without 
change for hermitian forms 

Closely associated with quadratic forms arc what are known 

as bilinear forms: 

definition 2 

If A iR a symmetnc matrix, the expression V^AX is known as a bilinear form. 

Clearly, if F = X, the bilinear form V^AX becomes the quadratic 
form X^AX. If the components of Y are thought of as the 
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coordinates of a ^^point'' in a hyperspace of the appropriate 
number of dimensions, the bilinear form Y^AX is sometimes 
called the polar of the point Y with respect to the quadratic form 
X'^AX. 

It IS interesting to note that the scalar product of two vectors 
Y and X, namely, F^X, can be thought of as the bilinear form 
YTix The condition that F and X be orthogonal is, then, just 
the condition that the bilinear form F^/X be equal to zero. This 
suggests that the simple notion of orthogonality introduced in 
Sec. 10 2, by analogy with the familiar results of solid analytic 
geometry, be extended to include the following concept of gen¬ 
eralized orthogonality: 

DEFINITION 3 

Two vectors X and F are said to be orthogonal with respect to a symmetric 
matrix A if the bilinear form Y'^AX is equal to zero 

In the spirit of Definition 3, the notion of the length of a 
vector can also be generalized In fact, the definition of the length 
of a vector X introduced in Sec 10 2, namely, \/ X^X, can be 
rewntten y/X'^JX, and this suggests 

v/T^'lx 

as the generalized length of the vector X with respect to the 
symmetric matrix A This is meaningful, however, only if the 
quantity under the radical is positive Hence, it is necessary to 
require further that A be the matrix of a positive-definite 
quadratic form. A vector whovse generalized length with respect 
to a given symmetric positive-definite matrix is I is said to be 
normalized with respect to that matrix A vector X can always 
be normalized with respect to a given symmetric positive-defimlc 
matrix A by dividing it by the positive quantity \/ X’^AX 

Clearly, the Schmidt orthogonalization process, which we 
discussed at the end of Sec 10.5, can be carried out equally well 
using the concepts of generalized orthogonality and generalized 
length The notion of orthogonality with respect to a nonunit 
matrix will be of considerable importance in the work of this 
chapter 

Just as it was convenient in analytic geometry to be able 
to remove the cross-product term from the ecpiation of a conic, 
so in many applications involving quadratic forms it is desirable 
to be able to remove the cross-product terms by a suitable trans¬ 
formation and express the quadratic form as a sum of squares 
There are many ways of doing this, among which the followings 
due to Lagrange, is particularly effective. The general idea is 
first to group together all terms containing X\ as a factor and, 
by suitable manipulations, make this expression a perfect square 
Then, among the terms that remain, those which contain 
as a factor are rearranged into an expression which is a perfect 
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square; and so on, until the process terminates The original form 
will then appear as a sum of squares of linear polynomials in 
(a;i,X 2 , . . . ,x„), (x2,a:3, . . . ,x„), . . , (Ih_i,xO, and x„, re¬ 

spectively , and wlion these expressions are taken as new variables 
the reduction is complete. 

To begin the process let us assume that an 0 and group 
together all terms containing Xi as a factor; 

n 

-h 2ai2XiX2 -f * -h 2ainXiXn) H- ^ ar.XrX, 

r,**-2 

= an(xi^ +~^-XiX2-f -h .TiXn )-I- 0iU2,Xa, . ,J«) 

Now, adding and subtracting the appropriate terms, none of 
which involves Xi, we have 

an [(t, + — JTj + + —.In') 

f V an / 

-fe)’-’- -te)'- 


— 2-- X2Ta 


Oi.n-l ain 

2 - Xn—iXn I 

flu ail J 

4- (^j(X 2 ,X 3 , ,Xn) 


an H X2 -f- + Xj\ </>2(X2,.t3, . ,X„^ 

\ Uii an / 


The obvioii.sly nonsirigular traiisforiuation 


I a]2 

//l = Xi 4-X2 

an 


, a„. 

4 ^ Xn 

On 


7’i Ih 


now reduces Q{x) to the form 
any\^ “h 02(V2,2/.3, >?/«) 

where <t> 2 {y 2 ,y-^, .vJ course, a quadratic form in the 

7i — 1 variables 7 / 2 , 2 /. 1 , , Vn, with coefficients say 

The same pioce.ss is next applied I 0 02 , and a second non¬ 
singular transformation, of the form 

2i = yi 

I i -L bin 

Zi ^ ?/2 4- r- 2/3 4- + r- yn 

O 22 022 
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extends the reduction to 

+ 652 ^ 2 ® + . - . jZn) 

The continuation is now obvious, and the required transformation 
IS, finally, the product of the successive transformations Ti, 1\ 

If at any stage all square terms are missing from the form 
,Un) the process must be modified If this occurs, 
either no more terms remain and the reduction is complete, or 
else there is at least one cross-product term with nonzero cpcffi- 
cient, say UjUj+i If this is the case, the iionsingular transformation 

Wi = u[ 

Ut-i = 

Uj - w' + w'^.1 
Uj^l = Uj - ^' 4.1 

Un = ul 

will clearly introduce a term in and the process can he 

continued in its original form. 

It IS important to note that the linear transformation 
employed at each stage is rank-preserving Hence, since the rank 
of a diagonal matrix is equal to the number of its nonzero diagonal 
elements, it follows that, when X^AX is transformed to a sum 
of sfiuares by the Lagrange reduction, the number of scpiare 
terms present in the final result is equal to the rank of the matrix 
of the original form It is also clear that, when a positive-dehnilc 
quadratic form is reduced to a sum of squares by the Lagiangc 
reduction, the final result must consist of the square of each 
variable with a positive coefficient 

EXAMPLE 2 

Find a transfomtiation which will reduce to a num of squares the quadratic form X'^AX, where 


1 

-1 

2 

0 

-1 

2 

-2 

1 

2 

-2 

5 

1 

0 

1 

1 

4 


Following the Tjagrange procedure, we first group together the terms containing ii a 
factor, and then complete the square on these terms 

(ii* — 2x]Xi -I- 4x,i3) + ( 2 a;i* — 4x2Xa + 2 j2 X« 5xj* + 2 x 3 X 4 -|- 4x4^) 

- l(xi - X, + 2 x,)> - xa* -h 4 x 2 x 3 - 4 x,*] 

-h (2x2* — 4 x 2 Xs H- 213X4 + 5xa* + 2x3X4 -f 4x4*^ 

- (xi — Xi -h 2x,)> + (xa* -f 2xaX4 + is* + 2xjX4 4- 4X4*) 
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Now we appl}^ the transformation 

1/1 “ xi - jj 4- 2x, 

yr =“ X 2 

T, 

1/3 “ X, 

y* “ Xi 

Retting 1/1* + (i/2* + 2yiyi + y^'^ -f 2y^yi -f- 4i/«*) 

We next apply the same procedure to the function of 1 / 2 , i/a* 1/4 which remains 
j/r + (l/i* H- 21 / 2 V 4 ) + (i/j* + 2 i/,i/ 4 -h 4?/**) - 1 /,’ + ((y, 4 ^ 4 )* - 1/4^1 4 (?// + 2 viV4 f 4i/4*) 

“ 1 / 1 * 4 iyt 4 VaY 4 (./• I 2i/,7/« + 3v4*) 

We now apply the transformation 

z\ =» yx 

^2 “ 1 /i f 1/4 
J 2 

2 a = yt 

24 = Vi 

getting 4 22 ^ 4 ( 23 * 4 2zxzx 4 

A lepetition of the process now yields 

21'-' + 22 * 4 (23 4 ZxY 4 2.'!* 

ifcncc, the final transformation 


ICi = 2i 
W2 = 2j 

ics = zj 4 24 

UU =“ 24 


1 educes the original quadratic foim to tin expression 

i/’Y 4 iC 2 ^ 4 u>i~ 4 2wi^ MS leipiired 


Th (3 single transformation whu h ucf oinpliahcs the rcdudion is of (oiirsc the piodm t of the 
transformations T], T^, and Ti, that is, the transformation vnIik Ii rc'sults when thi' ?/'s and z'h 
are eliminated and the w’s are expressed directly in terms of the j's 'Phis is easily found to he 


T 


] 

-1 

2 

0 

0 

1 

0 

J 

0 

0 

1 

1 

0 

0 

0 

1 


To verify that this transformation actually reduces X'^AX to a sum of squares, it is neces¬ 
sary that the transformation T he solved for .V, so that we can substitute for X m the (‘xpressioii 
AX T'o do this, we multiply both sides of the equation IT = PX by the inverse of P, which 
surely exists since P is nonsmgular This gives us 


T-*- X ~ P-^W 


tender T~^ the original form becomes 


] 

1 

-2 1 

0 

1 

0 -1 

0 

0 

1 -1 

0 

0 

0 1 


(P-IW)^A(P-^W) - W^{P-^)^AP-^W » W^\{P-^yAP-^]W 
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and it le easy to verify that ifl indeed the diagonal matnx 

10 0 0 
0 10 0 
0 0 10 
0 0 0 2 

If f(xi,X 2 , . . . ,Xn) IS a function of n variables which 
possesses first partial derivatives in the neighborhood of some 
"point” P. (ai,a 2 , . it is shown in calculus that a neces¬ 

sary condition for / to have a maximum or a minimum at the 
point P IS that at P each of the first partial derivatives of / be 
zero. In elementary calculus, sufficient conditions for a point P 
to be a maximum or a minimum of / are usually not obtained, 
but, with the fundamental properties of quadratic forms avail¬ 
able, these can be formulated in a relatively simple way In doing 
this, we shall use the Taylor expansion of / around the point F 
(ai,a 2 , . . ,a„), which mean.s that our conclusions are valid only 

for functions possessing such expansions * 

Under our assumption that / has a Taylor expansion around 
the point P (ai,a 2 , . . . ,an)j we can write, using the operational 
notation developed in calculus, 

/(xi, . . ,x„) = /(Oi, ,a„) 

+ [(*.- a.) -J- + + (x„ - «„) 3 ^;]/(x„ 

+ (x„ - o„) ^ j /(x„ 

■ ■ ■ 

+. 

Now, by hypothesis, 

#1 =• =^l =0 

dXi |ai.On dXn |oii • 

Hence, letting \t = Xr — a,, we have 
(3) /(ii, . . - ,x«) - /(a,, . . ,an) 


1 r d 






‘ ■ 

ai, ■ 

. ,ai 


-|- terms involving the third and higher 
powers of the infinitesimals Xi, . - • » 

• Actually, if we use Taylor's theorem rather than Taylor’s expansion, we 
need assume only the existence of the third denvatives of /. 
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Clearly, in the neighborhood of P\ (ai, . . . ,(a«) the principal 
part of the right-hand side in the last expression is in general the 
first group of terms, which together constitute a quadratic form 
m the X’s in which, specifically, the coefficient of the product 

\\j 18 


ay 

dx, dXj ai. 


,an 


f ^ j and 


1 

2ax,^|ai.. ,an 


I = J 


Now P' (ai, . will be a local maximum of / if and 
only if the difTerenee f{xi, . — /(aj, . .a„) is negative 

for all suffinentlv small values of X, = j, — a, (i = 1, 2, . . , n) 

which are not all zero And this will be ^he case if the quadratic 
form m the X’s is iiegative-dehnite Similarly, P will be a 
local minimum if and only if the dilTert nee f(x\, . . ,.Tn) — 

/(ui, ,o,n) IS jiositive fur all .sufficiently small values of X, 

which are not all z(‘ro. and this vill be :he case if the (juadratic 
form in the X’s is positive-definite Th(^ point P will he neither a 
maximum nor a minimum if tlie dilTerence f{x\, ,a„) — 

/(ui, ,a„) IS sometimes jiosiiive and sometimes negative in 

the neighborhood of P, and this wdl be th(‘ ca.sc if the quadratic 
form in the X’s indetinite Finally, if the quadratic form in the 
X’s is semidehnite, there are points distinct from, but arbitrarily 
close to, P at which the form is zeio, and it is therefore not the 
principal part of the right-hand side of Eq (3) In this case, a 
decision requires a con.sideration of the cubic (cpiartic, ) 
terms in X, and takes us beyond the bounds of matrix theory 


EXAMPLE J 

Examine the function 


Gji F 2j 3 + Ji* - 2/122 F 2/2* F 2/2 Jj F 3/8* 

for maxima and minima 

To determine at what points, if any, the given function muv have maxima or minima, we 
investigate the solutiorih, if any, of the three equation.s 


- 

d/i 

-6 F 2/, - 2/2 

- 0 

a/2 

— 2/1 F 4/2 

F 2/ « 0 

a/3 

2 F 2/2 

F 6/3 = 0 


From those we find that the only poasibility for a local extremum is the point P 
Clearly, = 9 and — — — “ “ 0 at Moreover, at P, 

d/i fJij 


(8,5,-2) 


diP 

a/2* 


2 


4 


a/i a/2 


±'L. 

dx] a/j 


0 


d/3* 


- 6 


d/j d/s 
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Hence, 

^ |2(^i - «)’ - 4(i. - 8)(*J - 5) 

+ 4(1, - 5)« + 4(1, - 5)(i, + 2) + 6(i. + 2)’) + 

The second-degree terms in (ji — 8 ), (ij — 5), and Cij f 2 ) in this expansion constitute a 
quadratic form whose matrix is 

1-1 0 
-1 2 1 

0 1 8 

By Tiieorem 1 , this quadratic form is positive-definite, hence, the point (8,5,— 2 ) is a local 
minimum of the given function 

EXERCISES 

1 Classify each of the following quadratic forms 

a xi’ -h 4 x 2 ® + 4xa^ + 4 xiX 2 + 4 xii 3 + 6 j‘ 2 J '3 
b 3 xi^ -h 3 x 2 * + — 2 xiX2 — 4 xiXi 

c —Xi* — 3x2* — fijra* + 2 xiX2 + 2 xiXi + 2x2X3 
d 2xi* -h 2x2* + Xg* -h 2x1X3 + 2xii3 

2 Find a transformation winch will reduce each of the following quadratic forms to a sum of 
squares 

a Ji* + 5x2* -t 2x3* + 4 jiX 2 + 2x1X3 -1- 6x2X1 

b xi* + 5 x 2 * + 5 xg* + 2 x 4 * — 2x1X2 + 4x1X3 + 2x1X4 - 6x2X4 + 2x3X4 

c X1X1 + X3X4 d X1J2 + XaX4 + X4X6 + XfiJe 

8 If nX) = show that f{\X -h nY) = X*Y^4Y + 2X^YM -f 

4 If A IS ajinmetnc, show that }"^/lY — X'^AY 

5 Examine the following fum tionn for maxima anti minima 

a 2x1* 4 - 2x1x2 4 X2* 4 Ox, 4 6x2 4 3 
b xi* — 2x1X2 4 2x1X3 — 4x2X3 4 4 xi — 4x2 4 4 xa 4 4 
c - 2 xi* - 2x2* - X3* 4 2x,x2 4 2x2x3 4 4 x, - 4x2 4 2x3 - 3 

d Xi“ 4 X2* — 3 xi e xi’’ — 3 xiX2 4 X2* 

f sin xi 4 sin X2 4 eos (xi 4 X2) 

6 Show that in the neighborhood of any zero of an indefinite quadratic* form the form takes on 
both positive and negative values 

7 Prove that a nonsiiigular quadratic form cannot be .sernuiefinite 

8 If A'^.4A' IS a positive-definite quadratic form, show that (A’ !>')* ^ (A'^4A')(h^ 11 \ 
the equality sign holding if and only if either A’ or >’ is a null vector or A = (Hint I 
the result of Exerr isc 3 ) 

9 From the vectors t'l = ||J 0 0||, V 3 = ||0 1 OH, F 3 = IjO 0 1||, construct a sot of 

vi'ctors orthononnal with respect to the matrix 

1 1 0 
1 2 0 
0 0 2 

10 a Find llie potential energy stored in the system shown in Fig 10 1 , Sec. 10 3, as a result 
of the diaplacemeiits Xi, X 2 , and X 3 , and show that it is a positive-definite quadratic function 
of the x's (Hint The work required to stretch a spring of modulus k a distance s is ’ 2 ^'''' ’ 
b Work part a for the system showm in Fig. 10.2, Sec 10.3 
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11.2 

The characteristic equation of a matrix 


In studying linear transformations of the form 




y\ 


flu 

ai2 

Ctln 


Ti 

y = AX 

where Y = 

2/2 

A = 

O 21 

022 

02n 

A" = 

Xi 



Vn 


Unl 

(ln2 

Ofin 




it iR an interesting and important problem to determine what 
vectors, if^ny, are left ufi^ang^d'in dTrrei.k)!l SUrce two non- 


t-nvial vectors have the same dn^ction if and only if one is a non¬ 
zero scalar multiple of the other, this is e(iuiv«lcnt to the question 
of determining those veclon'. A" whose images Y are of the form 
y = \X, that is, those vectors X such that 


AX = XX or 

(A 

^0^ 


Clearly, the matne equation (A - 
scalar system 

- X/)X - 

0 i.R equivalent to the 

(flu “ X)xi + 

fll2J2 + 

4- 

ainXn ^ 0 

<l2\Xl + (fl22 

— X)a‘2 + * 

+ 

ainXn = 0 

aniX\ -f- 

flr 2-^2 + 

4" (flfiri 

- X).r„ = 0 


and, according to Corollary 1, 7'heorem 7, Sec. 10 5, a homoge¬ 
neous e(iuatJon of this .sort will have one or more nontrivial sotu- 
tions if and only if the determinant ol the coefficients is equal to 
zero Thi.s condition, namely, 


( 1 ) 


|A - X/| 


(an — X) ai2 
^21 (^22 ~ 


ani 


ttln 

0>2n 


= 0 


(flnn - X) 


IS obviously a polynomial equation of degree n in the parameter 
X with leading coefficient ( — 1)"' 


(2) \A - X/| = (-1)"[X" - ^liX- ^ -f ^2X"-=* 

+ +(-n-fs.] = 0 


Both this equation and the equivalent equation obtained by 
dropping the factor (—1)" are known as the characteristic equa¬ 
tion of the matrix A, and the expression in brackets is known as 
the characteristic polynomial of A. For values of X which satisfy 
Eq. (2) and for these values only, the matric equation 
(A — \I)X = 0 has nontrivial solution vectors. The n roots of 
Eq. (2), which of course need not be distinct, are called the 
characteristic roots or characteristics values of the matrix A, 
and the corresponding solutions are called the characteristic 
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vectors* of A. Although we have introduced the idea of char¬ 
acteristic values and characteristic vectors of a matrix in connec¬ 
tion with the specific problem of determining the vectors left 
invariant in direction by a linear transformation, these concepts 
are of fundamental importance in much of matrix theory and in 
many of its physical applications. 

Since most applications involve matrices which are either real 
and symmetric or hermitian, we shall for the most part restrict 
the rest of our discussion to the characteristic values and charac¬ 
teristic vectors of such matrices. We begin, however, with several 
theorems which deal with the characteristic values and character¬ 
istic vectors of arbitrary square matnces. 

Since the characteristic equation ( 2 ) of a square matnx A is a 
polynomial equation, its roots, say Xi, X 2 , . , X„, are connected 

with its coefficients ~/3i, 182 , • , by the well-known 

root-coefficient relations 

/9i = Xi + X 2 -f- ■ • + Xn 

02 == X 1 X 2 “h XjXa - j- ■ * -f* X„_iX„ 

0 n ~ X1X2 ‘ Xfi 

Furthermore, if we set X = 0 in Eq (2), we obtain 


(4) |A| = (-iy-0n = 0n 

Hence, from the last of Eqs. (3), we have 

1 A| = X1X2 ■ • X„ 

From this it follows that |A| is zero if and only if at least one of the 
X's is zero Thus we have established the following theorem. 


THEOREM 1 

A matnx is singular if and only if at least one of its characteristic values is zero 

Equation (4) is only the first of a senes of relations connecting 
the coefficients in Eq. (2) with the principal minors of A For 
instance, if \A — X/| is written as the sum of 2” determinants by 
repeated use of the addition theorem (Theorem 9, Sec 10 1), it is 
clear that the terms containing the first power of X are obtained 
by multiplying the term —X in each diagonal element of \A — X/| 
by the X-free part of the cofactor of that element Thus, the coeffi¬ 
cient of X m Eq (2), namely, 

IS equal to -(An -|- Aa 2 + ' ’ -h A„„) 


• Some writers graft the German word eigen meaning oi/m, peculiar, or 

onto the words values and vedora and use the hybrid terms eigenvalues and 

eigenvectors. 
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Hence, it follows that 

= ill! -j- ^22 -|- Ann 

Similarly, the terms containing X* in the expansion of |A — X/| 
are found by multiplying the terms containing —X in every pair 
of diagonal elements by the X-free part of the algebraic comple¬ 
ment of the second-order minor containing those diagonal ele¬ 
ments Thus the coefficient of X“ in Eq. (2), namely, 

(-1)2"-2/3„_2 - 0n-2 

IS equal to 12 ~1“ ^13. la “b ■ ■ ‘ H” An-^ 

The continuation is obvious, and we, ^OLiefore, have the follow¬ 
ing theorem. 


THEOREM 2 

If X" — /9iX" ’ + + ( —1)" iX -b (—0 IS the characteristic 

equation of a square matrix A, then /3, is equal to the sum of all the principal 
minora of order i 111 A 

For ? = 1 we have, as a special case of Theorem 2, the relation 
= Xi -b X2 "b ■ ' * 4- X„ ~ On + 022 -b ’ ‘ -b Onn 

The quantity On 4- 022 “b 4- a„n is called the trace of A 
The characteristic polynomial of a matrix A and, hence, the 
coefficients (/3t) and the characteristic roots |X,| have the inter¬ 
esting property of being invariant under any similarity transfor¬ 
mation More precisely, we have the following theorem’ 


THEOREM 3 

If ^ and B are similar square matrices, then A and B have the same characteristic 
polynomial. 

PROOF Let |i4 — X/| be the characteristic polynomial of the matrix A, and 
let .fi be a matrix similar to ^4 , 1 c , let ^ be any matrix such that B = S"^AS 
Then the characteristic polynomial of B is 

\B - X/| - \S-'AS - X7| 

= I.S-M5 - XiS-‘/^| 

= \S'K^ - ^I)S\ 

^ |S->1 ■ - X/| |S1 

since the determinant of a product of square matrices is equal to the product of 
the determinants of the individual matrices Moreover, by Corollary 2, Theorem 1, 
Sec 10 3, \S~^\ |aS| = 1 . Hence, \B — X/| = \A — X/|, as asserted. 

The next three theorems also deal with the characteristic 
values and characteristic vectors of arbitrary square matrices; 


theorem 4 

A characteristic vector of a square matrix cannot correspond to two distinct 
characteristic values. 
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PROOF Let Xi and \2 be distinct characteristic values of a square matrix 
A, and let Xi be a characteristic vector of A corresponding, if possible, to both 
Xi and X2 Then, simultaneously, 

{A - \ J)Xi = 0 and (A - Xa/)^! - 0 

Hence, subtracting, 

(5) (X 2 - Xi)/Xi - (X 2 - Xi)Xi = 0 

However, by hypothesis, Xi 5*^ X2 Moreover, a characteristic vector is, by defini¬ 
tion, a nontrivial solution vector of (A — \I)X = 0 Thus Xi 9 ^ 0, and therefore 
Eq. (f)) cannot hold Hence, the assumption that a characteristic vector can 
correspond to two distinct characteristic values must be abandoned, and the 
theorem is established. 

THEOREM 5 

IfXijXi, . . , (m ^ a) are characteristic vectors corresponding respectivciv 

to the distinct characteristic values Xi, X2, . , Xm of an {n,n) matrix A, then 

Xi, X 2 , . . , Xm are linearly mdepcndent 

PROOF Let X\, X 2 , , Xm he charaetenstic veetors eorrosporiding lespec- 

tively to the distinct characteristic values Xi, X2, , Xm of a sipiarc malriv 1, 

and let us suppose, contrary to the theorem, that X\, X 2 , . , are dcpeiul- 

ent More spceifically, let us suppose that the maximum number of linearly 
independent vectors m Uic set is /f, where ] ^ k < m, and, for eonvenicnciy 
let them be the first k X’s Then the relation 

4“ + H" CXkXn = 0 

implies that ai - 02 ~ • ■ = 0, but there does exist a nontrivial set 

of i3\s, with 0, such that 

(6) 0 iXi -b P 2 X 2 + “b /3jfcXjfc -b Pk\^iX/r^i — 0 

Now multiply Eq. (0) on the left by the matrix A, getting 

fiiAXi -b f^ 2 AX 2 4" 4" fikAXk 4" ^k^ lAXk^] = 0 

However, AX, = X.X', for each 1 Hence the last equation becomes 

(7) ^iXiXi 4“ ^2X2X2 4“ “b ^fcXfcXfc 4" ^y+i^k+iXkJ^i — 0 

If we now multiply Eq (fi) by Xjt+i and subtract from Eq (7), we obtain 

(8) (Xi — Xfc^i)/3iAi “b (X 2 — \k+^)P2X2 4" ■ 4- {\k — Xfcfi)/3fcX<r — 0 

Since Xi, X2, , Xk are linearly independent, by hypothesis, it follows that 

each coefficient in (8) is equal to zero. Hence, since X, — X^+i 0 (r = L 2, 
. . . , /c), it must be that 

/3, = 0 1=1,2, . ,k 

But, if this IS the case, it follows from (6) that 

/3t^.lXt^.l = 0 

which is impossible, since neither the scalar pk^-i nor the vector Xjt+i is zero 
This contradiction overthrows the possibility that the characteristic vectors 
Xi, X2, , Xn are linearly dependent, and the theorem is established. 
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In particular, if an (n,n) matrix has n distinct characteristic 
values, the last theorem tells us that it has n hnearlj^ independent 
characteristic vectors Ilcnce, using Corollary 1, Theorem 10, 
Sec 10.5, we have the following result' 

COROLLARY 1 

If the characteristic values of an (n,n) matrix A are all distinct, then A has n 
linearly independent characteristic vectors, and any vector with n components 
can he expressed as a linear combination of the characteristic vectors of A, 

Since (he chara(;teristic ecpiatiori of an (7i,n) matrix is always 
of degiee /i, it is obvious that, if repeater! roots aie counted the 
appropriate number of times, such a matrix alv.ays has exactly n 
characteristic roots With the same conv( ntiuii one might perhaps 
be able to say that an (ft,ft) matrix always has exactly n char¬ 
acteristic vt'ctors However, attempting to assign a multiplicity 
to a dial act eristic v(‘cto( 'issociaKsi with a iepeat(‘d characteristic 
root IS completely aitihcial and williout significance The decisive 
consideration is th(‘ number of linearly independent characteristic 
vectors of a given matrix, henc(‘, it is of fundamental importance 
to know when more than one independent characteiistic vector 
is associated with a n‘p(‘ated chaiact.eristic root The next tlieorem 
gives us a partial answa^r to this question' 


THEOREM 6 

If Xi IS a characteristic root of multiplicity r of an (n,n) matrix A, then the rank 
of A — Xi/ IS ecjual to or greater than ri — r 

PROOF If A IS an (n,n) matrix and if X = Xi is a repeated root of multiplicity 
r of the characteristic equation |A — X/| = 0, then, writing X = Xi *f it ift 
clear that ici = 0 is a repeated root of multiplicity r of the equation 

|A - (Xi -f w)l\ - |(A - \ J) - wl\ - 0 
Hence, the expanded form of the last equation, say 

( —l)"[lC" — -h (r2lC"-^ — A (—I)"* Vn-llC A (—])V,.l = 0 

must contain ic’' as a factoi and must, therefore, reduce to 

(— — CTilC"'^ A A (— 1)” ’’an-r'lC’'] = 0 

where Un-r ^ 0 Now, by Theorem 2, the coefficient (7^-r is equal to the sum of 
all principal minors of order rt — r of the niairix A — XJ Hence, since (7„^r ^ 0, 
at least one of these minors must be different from zero In other words, the 
rank of A — Xi7 must be at least as great as n — r, as asserted 

If, for a particular root Xi of multiplicity r of an (n,n) 
matrix A, the equality sign holds in the assertion of Theorem 
6, then, according to Theorem 6, Sec. 10 5, there arc exactly 
n — (n — r) = r linearly independent characteristic vectors as¬ 
sociated with Xi Such a characteristic root is said to be regular. 
However, this is the exception rather than the rule, and, in 
general, there will be a single independent characteristic vector 
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associated with a repeated characteristic root of any multi¬ 
plicity. For instance, for the matrix 



we have \A — X/| 


-3 - X -7 -5 

2 4 - X 3 

1 2 2 - X I 

-X» -h 3X2 - 3X 4- 1 = -(X - \y = 0 


Thus, A has a single characteristic root X — 1 Moreover, for 
X - 1, the rank of 


1^ - X/lx-i = |A - 71 


-4 -7 -5 

2 3 3 

1 2 1 


IS clearly 2 Hence, according in Theorem 8, Sec 10 5, the system 
of equations (A — I)X = () has a single independent solution 
vector, namely, 


X = 



and A has just one independent characteristic vector 

Later in this section we shall see tliat for hermitian matrices 
the assertion of the last theorem can be sharpened to a strict 
equality, in other word.s, we shall prove that, if X = Xi is a char¬ 
acteristic root of multiplicity ?' of a hermitian matrix A, then 
the rank of |A — Xi/| is exactly n — r Preparatory to this, how¬ 
ever, it will be convenient to prove hrst some other theorems 
about hermitian matrices 


THEOREM 7 

The characteristic values of a hermitian matrix are all real 

PROOF Let A be a hermitian matrix; let Xi be any one of its characteristic 
values; and let Xi be a characteristic vector corresponding to \i Then 

(A - Xi7)Xi = O 
or 

(9) AXi = XiX, 

and from this, by premultiplying by X/, w^e obtain 

(10) Xi^AXi = XlA^^Xl 

Now, from the properties of conjugate complex numbers, Xi^Xi is real and in fact 
positive Furthermore, from Theorem 4, Sec 11.1, we know that Xi^AXi is also 
real. Hence, it follows immediately from Eq. (10) that Xi is real, as asserted. 
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Since, as we observed in Sec. 10.2, a real symmetric matrix 
is just a special case of a hermitian matrix, \\e have the following 
important corollary of Theorem 7 

COROLLARY 1 

The characteristic values of a real symmetric matrix are all real 

Furthermore, since iA is hermitian if A is skew-hermitian 
and since \A — X/| = 0 implies \iA — VX/j = 0, it ullows that, 
if Xi is a characteristic value of the skcw-hermitia.. matrix A, 
then iXi is a characteristic value of the hermitian matrix lA. 
Hence, by Theorem 7, tXi is real, mn tiiercfore, Xi is a pure 
imaginary Thus we have established the foll(>wing result' 

COROLLARY 2 

The characteristic values ol a skew-hermitian matrix itre all pure imaginary 

Knowing novs thal the charneteristic roots of a hermitian 
matrix A are all real, we can n^tuni to the ( haracteristic equation 
of A and prove the following result 


THEOREM 8 

If X" — — + ( —l)^“^/3„_iX -h (—= 0 IS the char¬ 

acteristic equation of a hermitian matrix A, then the charactenstie roots of A 
are all positive, if and only if each (i is positive 

PROOF Ifi4isa heimitian matrix, it follows from Theorem 7 that the roots 
of the characteristic equation 

X" - 2 _ 4 . (_|)« 4 - (-l)"dn - 0 

are all real Kurthermore, if eacli is positive, it follows Descartes's rule of 
signs that no root of tin charactenstie equation can be negative or zero Hence, 
all tlic characteristic roots must h(‘ positive Conversely, if the characteristic 
roots of A are all positive', then from the root-eoefhcient relations 

p’l — Xi + X2 “h “h X„ 

=-. XiX, f XiX, -h -f 

dn = X1X2 x„ 

it follows at once that each d positive, as asserted 

COROLLARY 1 

If X" — diX^‘ ' -f- d2X^'" ” + (-l)"‘“^dn^-iX 4- = 0 IS the char¬ 

acteristic equation of a real symmetric matrix A, then the characteristic roots 
of A are all positive if and only if each d is positive 

One of the most important properties of the characteristic 
vectors of a hermitian matrix is that of orthogonality. More 
precisely, we have the following theorem 
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THEOREM 9 

If Xi and Xj are characteristic vectors corresponding, respectively, to the distinct 
characteristic values Xt and X, of a hermitian matrix A, then XJX; = 0. 

PROOF By hypothesis, we have 

(11) AX. = \.X. 

( 12 ) AXj = \,Xj 

If in the first of these we take the conjugate and then the transpose of each 
member, we obtain 

XJA^ = 

or, since A'^ = A, by hypothesis, and X. = X», by Theorem 7, 

(13) Z/A = X.XJ 

Now, if we premultiply Eq (12) by X/ and postmultiply Eq (13) by X,, we 
obtain, respectively, 

XJAX, = XjXJXj 
XJAXj - X.XJX, 

Finally, subtracting these equations, we have 
(X. - Xj)X.'^Xj = 0 
or, since X» 5*^ X, by hypothesis, 

XJXj ~ 0 as asserted 

COROLLARY 1 

If .Y, and Xj are characteristic vectors corresponding to the distinct characier¬ 
istic values Xi and Xj of a real symmetric matrix, then A'd’Y; — 0 

We are now in a position to return to the question we Ia]^cd 
earlier in this section about the rank of \A — X,/| when A is 
hermitian and X» is a characteristic root of multiplicity r As 
the next theorem shows, every characteristic root of a hermitian 
matrix is regular, that is, if A is hermitian, then, for every char¬ 
acteristic root X, of multiplicity r, the lank of \A — XJl drops 
to the nimimuin permitted by Theorem (i, namely, n — r, lual 
there are r linearly independent characteristic vectors eorrespoiul- 
iiig to X, 

THEOREM 10 

If A is a hermitian matrix, then to every r-folcl characteristic root of A ihcic 
correspond exactly r linearly independent eharaetenstic vectors 

PROOF Let Xi be a repealed characteristic root of a hermitian matrix A , 
let Ui be any normalized characteristic vector corresponding to Xi, and let i 
be any unitary matrix having Ui as its fiist column In virtue of the Schnudl 
orthogonahzation process, it is clear that such a matrix exists Moreover, since I 
is unitary, that is, since it follows from Theorem 3 that the matiices 

U^AU - XI and A - X/ 
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have the same characteristic equation and, therefore, the same characteristic 
roots Now let us wTite U in partitioned form. 

U =\\Ur U, ■ ■ U, II 


Then, remembering that AU i = \\U i since, by hypothesis, is a characteristic 
vector of A corresponding to Xi, we have 


U'^AU = 


^■'1'-AIK/.-;. 


IK II 


Cv 


AU 1 AU 2 


AUn ! 


1 ! 

II 

T II 



r;/ 


Xi 

K\^AU2 

■ 0^^AU. 

U2^ 

|lx,r/iAf /2 • Au„\\ = 

0 

O^'^AU, 


UJ 


0 

VJA U 2 

• CJAU„ 


where the zeros in tlic first cnliinin of llii* hist matrix enter because U is a unitary 
inatnx, and, therefore, any two of its columns satisfy the relation 




1 i=J 

0 i 9 ^ j 


The remaining entries are not in general zero, since U^ and are not orthogonal 
with respect to the matrix A However, since A and, therefore, iV'AV are hermi- 
tian (see 8), it follows that the elements after tlie first in the first row 

must all be zero Thus 


and 


Xi 

0 

0 

0 

0 

«22 

a23 • ’ 

Ot2n 

0 

a32 

^33 ‘ 

Ot6n 

0 

OlnZ 

an3 ’ 

OCfin 


Xi - X 

0 

0 

0 

0 

0122 — X 

0-23 

02„ 

0 

atJ2 

033 — X 

a3n 

0 

Oln2 

On .1 

Onrt — X 


Theiefore, if Xi is a repeated root of 

\rFAU - X/| = IA - X/| = 0 

then Xi — X must be a factor of the minor of the element in the first row and 
first column of 1.4 — \ J\ But if this minor vanishes when X = Xi, then the rank 
of A — XJ is at most n — 2, since all other minors of order n ~ I obviously 
contain either a column of zeros or si row of zeros Hence, by Theorem 6, Sec 10.5, 
\A — XI\X - 0 has at least two linearly independent solution vectors, and A has 
at least two linearly independent eharacteri.stic vectors 

If the multiplicity of Xi is more than 2, the preceding argument can be 
repeated, using this time any unitary matrix U whose first two columns are any 
two orthonormal characteristic vectors corresponding to Xi. This leads to the 
conclusion that Xi — X must be a factor of the complementary minor of the 
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second-order minor in the first two rows and first two columns of 
IV'^AU - X/| = \A - X/| 

Hence, since all other (n — 2)-order minors obviously vanish, it is evident that, 
when X = Xi, the rank of A — X/ is not more than n — 3, and A, therefore, has 
at least three linearly independent characteristic vectors Clearly, this procedure 
can be continued until we reach the conclusion that, if Xi is an r-fold characteristic 
root of A, then the rank of A is at most n — r, and hence A has at least r independ¬ 
ent characteristic vectors But, by Theorem 9, A can have at most r independent 
characteristic vectors corresponding to an r-fold characteristic root. Hence, A 
must have exactly r linearly independent characteristic vectors, as asserted 

Since, as we have repeatedly observed, a real symmetric 
matrix is a special case of a hernntian matrix, it is clear that 
we also have the following result 

corollary 1 

If A IS a real symmetric matrix, then to every r-fold characteristic root of A t here 
correspond exactly r linearly independent characteristic vectors 

We are now in a position to prove the following fundamental 
theorem 

THEOREM 1 1 

Every (n,n) hermitian matrix has n linearly independent characteristic vectors 

PROOF Let A be an (n,n) hermitian matrix. It may, of course, possess one 
or more repeated characteristic roots, but, if it does, we know from the la^t 
theorem that to each root of multiplicity r there correspond exactly r linearly 
independent characteristic vectors Hence, A cannot have more than n linearly 
independent characteristic vectors Specihcally, let the characteristic roots of A be 

Xi, X 2 , . . , Xjk 1 ^ A; ^ n 

k 

let the multiplicity of X, be r,, where J = n, and let 

1-1 

Xi2f , Xtvt 

be r, independent characteristic vectors corresponding to X, Suppose, now, con¬ 
trary to the assertion of the theorem, that these n characteristic vectors of A arc 
not linearly independent. Then there exists a relation of the form 

(14) (cuAii “b ‘ ’ At cir,A^ir,) + (caiXai Ar ’ A- c^TiXirt) "b 

■ “h (CklXkl A~ ■ ■ "h CkrtXkrk) ~ ^ 

in which at least one c is different from zero 

Now consider a typical group of terms, say the ith, in the last expression 
By Theorem 3, Sec 10.5, unless the c's in such a group arc all zero, the combina¬ 
tion defines a characteristic vector corresponding to the characteristic value 
X — X». Thus, Eq (14) is simply an expression of the form 

CiXi -|- cjXa -h -b CkXk 
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in which each c is either 0 or 1 and at least one c is diflFereiit from zero. But since 
the X’s now correspond to distinct characteristic values, it follows from Theo¬ 
rem 2 that they are linearly independent and, hence, that each r must be zero. 
This contradiction establishes the theorem 

COROLLARY 1 

PJvery real symmetric (n,n) matrix has n linearly independent characteristic 
vectors 

If an {n,n) matrix has n linearly independent c*iaiacter!stic 
vectors, then, by means of the Schmidt orthogonalization process 
applied to the vectors in each of the sets corresponding to a 
repeated root, a set of normalized mutually orthogonal charac¬ 
teristic vectors can always be constructed Hence, we havT the 
following impoiiant result 

COROLLARY 2 

Every (n,7i) hermitian or real symmetnc matii\ has a set of n orthcnormal 
characteristic vectois 

An (7i,n) matrix wliose columns are orthonormal characteristic 
vecb>rs of an (n.n) matrix A is said to be a modal matrix of A. 

In manv ap[)hcatiuns in physics, chemistry, and engineering 
it IS necessary lo consider matne equations of the form 
(A — \B)X = () in which A and B are either hermitian or 
leal and symmetric Such an ecjuation will, of course, have 
nontrivial solutions if and only if the determinant of the co¬ 
efficients IS e(pjal to zero Paralleling our earlier terminology, 
the equation \A — \B\ 0 is called the characteristic equation 

of the \ystcm, its loots are called the characteristic roots or 
characteristic values of the sy.stem, and the corresponding non¬ 
trivial solutions aie called the characteristic vectors of the system. 
As one should expect, the theory of the equation (A ~ \B)X — 0 
reseinfilcs closely the theory of the equation (A — \I)X — O In 
paiticular, we have the following results 

THEOREM 12 

The equation {A — \B)X = 0 has zero as a characteristic root if jjid only if A 
IS singular 

PROOF This follows immediately from a consideration of the characteristic 
equation \A ~ \B\ =0 when the left-hand side is expressed as a polynomial in X 

theorem 13 

If A and B are hermitian (or real symmetric) matrices and if B is definite, then 
the characteristic values of (A — \B)X = 0 are all real 

proof Let A and B be hermitian (or real symmetnc) matrices, let B be 
definite, and let A'l be a characteristic vector of the equation 


(A - \B)X = 0 
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corresponding to the characteristic value Xi Then 

(15) AXi = XiBXi 

Hence, premultiplying Eq (15) by we have 

(16) 

Now, from Theorem 4, Sec 11 1, we know that both X/AXi and Xi'^BXi are 
real numbers. Moreover, since B is definite, Xi^BXi ^ 0 Hence it follows from 
Eq. (16) that Xi is real, as asserted 

By inspection of Eq (16), the following results are obtained 
immediately 

COROLLARY 1 

If A and B are hermitian (or real symmetric) matrices which are both positive- 
definite or both negative-definite, then the cliaractenstic values of 

(A - X^)A^ = 0 

are all positive. 

COROLLARY 2 

If A and B are hernutian (or real symmetric) matrices and if A is posit ive-detimt 
and B is negative-definite or vice versa, then the characteristic values of 

(A - \B)X - 0 

are all negative, 

THEOREM 14 

If A and B are herrnitian (or real symmetric) matrices and if A'l, A' 2 , ■ , 

are characteristic vectors of the equation (A — \B)X — 0 coriesponding, respec¬ 
tively, to the distinct characteristic values Xi, X 2 , . , Xjt, then the A’s satisfy 

the generalized orthogonality condition 

iijBXj = 0 (or XJBXj = 0) i 

PROOF Let A and B be hermitian matrices, let X, and \j be distinct chai- 
acteristic values of the equation (A — \B)X = 0, and let X, and Xj be char¬ 
acteristic vectors corresponding respectively to X, and X, Then 

AX, - X.BX. and AX, ^ XjBX, 

If we premultiply the first of these equations by X/’ and the second by X,'^, wc 
obtain, respectively, 

(17) X/AX, = X,X/BAA 

and 

(18) XJAX, = X,XJBX, 

Now, if we take the transpose and then the conjugate of each side of Eq (17), 
rejmembering that A and B are hermitian, we obtain 

(19) X,^AX; = xSJBX, 
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Finally, subtracting Eq (18) from Eq (19), wc have 

(X, - X,)X/^X, = 0 

Therefore, since X» ^ Xj, by hypothesis, it follows that 

= 0 7 7 ^ j as asserted 

If A and B are real symmetric mail ices, an almost identical proof carried through 
with X/ and A'/ replacing X/ and A"/, serves to establish the iiareiit hetical asser¬ 
tion of the theorem 

COROLLARY 1 

If A and B are hermitian for real sjnnmetrjc) matri. c', .md if A'^i and Xj are 
charactcnstic vectors of (A — \B)X -- O corrc'-pondnig, icspM'tively, to the dis¬ 
tinct characteristic values X, and \j, then YiMA'j ~ 0 (nr \JAXj - 0) 

PROOF This result lollows immedialelv fiom F.j (18) (or ttic equation 
AXf = XjX.’^BXj it A and H are leal svminMrn' imitru es) and the fact, guar¬ 
anteed by Theorem 14, that A,^/hV; 0 (oi \A B\, ” 0) 

THEOREM 15 

If *4 and B are lieirnitian (or real svmmetric mat rices), if B is eitlu'r positive- 
definite 01 iK'gat IV t'-detini (c. and if Ah, X 2 , , A a aie chai act (mmsI ic va*ctois 

of (A — X/f)A’’ — 0( orr(‘sp()nding, iespectiv(‘lv, to thedistinct characteristic values 
Xi, X 2 , , Xa, then Ah, A’o, , Ah are linearly indi'pendent 

PROOF Let A and B be hmanitian maliiccs, let B be detinite, and let »is 

suppose, cont 1 ai y to the t heorein, t hat t h(‘ chai act I'nst k' vectors A i, A o, , A a 

conesponding lespccl 1 velv to the distinet ehaiael cm istle values Ai, X 2 , , Xa. 

of (A - B)X - 0 luc Inu'ailv dcqxMuhml Then theri* (‘\isls a relation of the 
form 

CiA 1 T C'>X‘> + “h ca^xa- — ht 

in xvliieh at least one of the i s, sav' 1 is diffeienl from zc'i’o Xow, if we multiply 

(he last eijuation through on the h‘ft hy AT/y,t w(‘ get 

r,A'h/T\h 4 roA'4/fA2 -f f c,A;^7T\h -f 

T c.XJBX, = 0 

Howev'er, from the ort hogonalitV' guaranteed by I heortmi 14, h follows that 
evi'ry (eim in the last e(|uati(An ('\e<‘p1 c^XABX, is ec|iml to zero Xloieovei, bv 
hypothesis, B i,s (st her posit ive-detinite or m gative-definite lienee, XXBX, 7^0, 
and, Iherefoie, c, ^ 0, eonliaiy to the assumption of linear dependence This 
contradiction shows that the A’s must be linearly independent, and the 1 heoreni 
IS established 

The last theorem must not be misinterpreted as asserting 
that if A and B are hermitian (or real symmetiie) (nji) inatnei's 


t Tins profcdurr hullires wlion A and B arc real, svnimf'tnc roatnres, as 
AM'll aa when tlicv aro iu*rniitian hocausc, although 'I’lu'oretn 14 floos nf)t 
assert it explieith, Jt is elear that XABXj -= 0, i X J must also hold for 
real syniinetne matiiees, since these are just sjieeial cases of hermitian 
matrices. 
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and if B is definite, then (A — \B)X = 0 has n linearly inde¬ 
pendent characteristic vectors It guarantees that characteristic 
vectors corresponding to distinct characteristic values of 

(A - \B)X = 0 

are linearly independent, but it says nothing about how many 
distinct charactenstic values there are or about how many 
independent characteristic vectors correspond to a repeated 
characteristic value. If, because of repeated roots, 

(A - \B)X = 0 

has fewer than n distinct characteristic values, then, for all we 
know at present, (A — \B)X — 0 has fewer than n linearly 
independent characteristic vectors However, by a proof very 
much like the proof of Theorem 10, the following result can be 
established 

THEOREM 16 

If A and B are herniitian ((,r real symmetric) matrices and if B is either positive- 
definite or negative-definite, then to a repeated (characteristic lvalue of 

(A - \B)X = 0 

of multiplicity r there correspond exactly r linearly independent characteristic 
vectors 

With this theorem available, it is not difficult to establish 
the following counterpart of Theorem 11 

THEOREM 17 

If A and B are hermitian (or real .symmetric) (n,n) matrices and if B is either 
positive-definite or negative-definite, then the equation (A — \B)X = 0 luis 
exactly n linearly independent chaiacteristic v(‘ctors 

By a straightforward application of the Schmidt orthog- 
onalization process applied to the n linearly independent char¬ 
acteristic vectors of (A — 'hB)X ~ O guaranteed by Theorem 
17, we can establish the following useful results 

COROLLARY 1 

If A and B aie hermitian (or real .symmetric) (n,n) matrices and if B is definite, 
then (A — \B)X 0 possesses n characteristic vectois orthogonal wit h respect 
to B 

COROLLARY 2 

If A and B are hermitian (or real symmetric) {n,n) matrices and if B is positive- 
definite, then (A — \B)X = 0 possesses n characteristic vectors orthonorrnal 
with respect to B 

With Th('orem 17 and its corollaries available, it is now an 
easy matter to express an arbitrary vector C with ri components 
as a linear combination of the characteristic vectors of the equa- 
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tion (A \B)X = 0, provided A and B are hermitian and B 
is definite For we can write 


^ — ciX\ -h CiXi + ■ ■ ’ + CnXn 

where the A"’s are characteristic vectors of (A — \B)X = 0 
mutually orthogonal with respect to B. Then, if we premultiply 
Eq (17) by X^'^B we obtain 

AV5C = CiX.^BXi + • - + c^JCJBX, + ■ • -h CnJ^^'^BXn 


From the orthogonality of the X's, it follows that every term 
on the right except c.Xt'^BXt is equal to zero. Moreover, since B 
IS definite, it follows that JCJ'BX, 0 Hence, we can solve 
for c„ getting 

j^JBC 

- 1, 2, . . , n 


Ct = 




If the A’a have been normalized with respect to that is, if 
Xx’^BX, = 1 (i - 1, 2, . , n), the last formula reduces to 

the simpler expression 

Cy = XJBC z = 1, 2, , n 

The fact that we were able (o solve for the coefficients in the 
expression (20) without solving any simultaneous equations 
should make clear the gn^at convenience of working with a set 
of vectors which arc orthogonal 


EXERCISES 

1 Find the characteristic values and the corresponding characteristic vectors of each the 
following matrices 


a 

4 

6 

6 

b 

7 

-2 

-4 

c 

11 

-4 - 

-7 


1 

3 

2 


3 

0 

-2 


7 

-2 

-5 


-1 

-5 

-2 


6 

-2 

-3 


10 

-4 - 

-6 

d 

4 

6 

6 

e 

1 

1 

1 


f 

-4 

5 

5 



1 

3 

2 


1 

3 

3 



-5 

6 

5 



-1 

-4 

-3 


2 

1 

4 



-5 

5 

6 



For which of these, if any, are the characteristic vectors orthogonal? 

S Find the characteristic values and the corresponding characteristic vectors for the equation 
{A - \B)X - O, if 




8 

-2 

0 


8 

0 

oil 

a 

A - 

-2 

3 

-1 

B - 

0 

2 

0 



0 

-1 

2 


0 

0 

^ II 



2 

-1 

0 


3 

0 

0 

b 

A - 

-1 

2 

-1 

B - 

0 

4 

0 



0 

-1 

2 


0 

0 

3 



6 

-3 

0 


6 

0 

0 

c 

A - 

-3 

6 

-3 

B - 

0 

4 

0 



0 

-3 

4 


0 

0 

4 



3 

-1 

0 


4 

0 

0 

d 

A - 

-1 

1 

-1 

B - 

0 

1 

0 



0 

-1 

6 


0 

0 

4 
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In each case, verify all orthogonality relations, and, using orthogonality properties, express 
1 

the vector V ^ 2 as a linear combination of the characteristic vectors 

3 

S Find three solution vectors of the equation {A — 'KB)X — O which are orthonormal with 
respect to B if 



7 

1 

-1 


6 

0 

0 

a A — 

1 

4 

-1 

B - 

0 

3 

0 


-1 

-1 

3 


0 

0 

2 


7 

-1 

-1 


6 

0 

0 

b A - 

-1 

4 

1 

B - 

0 

3 

0 


-1 

1 

3 


0 

0 

2 


4 Prove Theorem 17. 

6 Prove Corollary 1, Theorem 17 

6 In Corollary 2, Theorem 17, why is it necessary to restrict B to being positive-definite? 

7 Prove that t^l is hermitian if A is akew-hermitian 

8 If IS hermitian and U is unitary, prove that O'^AU is hermitian 

9 Under what conditions, if any, is it possible for every value of X to be a characteristic value, 
of the equation (A — \B)X *■ 0? 

10 Show by an example that, if A and H are indefinite, the characteristic values of (A — \B)\ 
™ 0 need not be real, even though A and B are real and symmetric 

11 Show that, if either A or B is nonsingular, then AB and BA have the same characteristic 
values Hence prove that there arc no matrices A and B, with either A or B nonsingular, 
such that AB — BA “ J (These results hold even when both A and B are singular ) 

12 Show that the characteristic values of a real skew-symmetric matrix are either zero or pure 
imaginary 

15 Prove that, if a (2,2) matrix has characteristic vectors which are orthogonal, it is symmetric 
14 Prove that, if every characteristic value of a symmetric matrix is zero, the matrix is a null 

matrix Is this true if the matrix is not symmetric? 

16 Show by an example that Corollary I, Theorem 10, i.s false for symmetric matrices which 
are not real 


11.3 

The transformation of matrices 

In previous sections we have already encountered the idea of 
the transformation of matrices For instance, in Sec 10 4 we 
defined equivalent matrices as matrices A and B connected by a 
relation of the form 

B — QAP P,Q nonsingular 

Again, in Sec 11.1 we observed that, if the variables m a quad¬ 
ratic form X'^AX are subjected to a norisingular linear trans¬ 
formation A" = PYf then the quadratic form becomes 

V^BY where B = P’^AP 

In particular, we observed that, if a nonsingular matrix P can 
be found with the property that B = P^AP is a diagonal matrix, 
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then, in terms of the new variables introduced by the substitu¬ 
tion X = PY, the quadratic form X'^AX becomes just a sum 
of squares In this section we shall consider briefly the question 
of just when it is possible to transform an (n,n) matrix A into a 
diagonal matrix B by multiplying it on the right and on the 
left by suitable matrices P and Q. 

Because an equivalence transformation is simply a com¬ 
posite of elementary transformations, it is clear t^at, for any 
square matrix A^ many pairs of nonsingular matn es P and Q 
can be found such that QAP is diagonal In other words, we 
have the following result, which is little more than a restatement 
of Theorem 10, Sec 10 4, for square matrices 


THEOREM 1 

Any square matrix is equivalent to a diagonal matrix 

COROLLARY 1 

If a matrix A of rank r is equivalent to a diagonal matrix jB, then B has exactly r 

nonzero diagonal elements 

A square matrix cannot in general be transformed into a 
diagonal matrix by a transformation more restricted than an 
equivalence However, in many important special cases this is 
possible, as the following theorems show 


THEOREM 2 

A square matrix is congruent to a diagonal matrix if and only if it is symmetric 

PROOF The proof that, if A is sjunmetric, then it is congruent to a diagonal 
matrix was essentially given in our discussion of the Lagrange reduction in Sec. 
Ill For, if A is .symmetric, then it can be regarded as the matiix of a cpiadratic 
form, and the Lagrange reduction provides a linear transformation whose matrix 
P IS a nonsingular matrix with the property that P'^AP is diagonal 

On the other hand, if A is congruent to a diagonal matrix D, then there 
exists a noiismgular matrix P such that A = P'^DP Furthermore, if this is the 
case, then the transpose of A is 

= {P’^DPy -= P’^D’^P 

However, Z)^ = D, since any diagonal matrix is obviously symmetric. Hence, 

== pTDTp = pTDp = A 

Therefore, A, being equal to its transpose, is symmetric, as asserted 

From the nature of the Lagrange reduction it is evident 
that a symmetric matrix can be diagonalized by a congruence 
transformation in many ways, and among these there is always 
at least one which will simultaneously diagonalize a second given 
matrix, provided it is positive-definite More precisely, we have 
the following highly important theorem. 
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THEOREM 3 

Let Xi, X 2 , . . ■ , X„ be the (possibly repeated) characteristic values of the equa¬ 
tion (A — XjB)X = 0, where A and B are hermitian (or real symmetnc) (n,n) 
matrices and B is positive-definite Let Xi, X^, . . . , Xn be n independent 
characteristic vectors corresponding to Xi, X 2 , . . . , X„, and let the X’s be ortho- 
normal with respect to B. Let M be the matnx whose columns are the charac¬ 
teristic vectors Xi, X 2 , . . , Xn, and let D be the diagonal matrix whose diago¬ 
nal elements are the characteristic values Xi, X 2 , . . , Xn. Then M'^BM — 

and M’^AM = D 

PROOF Let Xi, X 2 , . , Xn be the characteristic values of the equation 

(A — \B)X = 0. Whether or not there are repeated roots among the X’s, we 
know, from Corollary 2 , Theorem 17, Sec 11 2 , that there exists a set of char¬ 
acteristic vectors Xi, X 2 , . . . , X„ orthonormal with respect to B, that is, 
such that 


(1) 

itJBX, = 

1 

0 

t ^ J 

1 ^ J 

Now, 

writing the modal matrix M 

in partitioned form, for convenience, we have 

(2) 

M = IIX. 

X 2 

• • Jf-ii 



Xi^ 1 




X2^ 

■ \\BX, BXi ■ BX„\\ 

and 

IH'^BM = 


II II 

Xi^5Xi Xi^J 5X2 Xi^BXn 

Xi^BX, X^^BX^ • • • X2^BXn 

Xn^^Xi XjBXi XJBX^ 

(3) = I by (1) 

Also, by premultiplying tiq. ( 2 ) by A and then using the fact that for each i 
the X’s are such that AXt = \^BX^, we have 

AM = ||AXi AX 2 • • AXnll 

= lIXiBXi X2BX2 • Xn^Xnll 
= B\\\,X, X 2 X 2 • XnXnll 

X O 

= B||Xi X, ■ X,||- 

O K 

= BMD 

Therefore, by (3), 

M'^AM = M'^iBMD) - (M'^BM)D = D 
which IS the second assertion of the theorem 

COROLLARY 1 

If A and B are hermitian (or real symmetric) matrices, if B is positive-definite, 
and if M 18 a matrix whose columns are characteristic vectors of (A — 'KB)X * 0 
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orthonormal with respect to B, then the substitution X = MY simultaneously 
reduces the hermitian (quadratic) forms and to f'^DY and 

fTjY = respectively, where D is the diagonal matrix whose diagonal ele¬ 
ments are the characteristic values which correspond respectively to the column 
vectors of M. 

The conditions under which a square matrix can be diag¬ 
onalized by a similanty transformation are contained in the next 
theorem 


THEOREM 4 

An (n,n) matrix is similar to a diagonal matrix if and o^'!> it it has n independent 
characteristic vectors. 


PROOF A be an (n,n) matrix, and let us suppose first that A is similar 

to a diagonal matrix 


O j 

022 j 

O i 


I hat IS, let us suppose that tliere exists a matrix S with the property that 
(4) S- ^AS = D 

If, for ronve °nce, we write S in the partitioned form 

s = ||.s. .s„|i 

we have, by premultiplying Eq (4) by *S, 


AS -= SD 


or ||A*Si A Si 


Hence it follows that 


A.S„|| - |i,Si .S 2 


= !|dii5i dnSi 



! O d. 

dnnSnW 


AS. =-- d..S. = dJS. 7 - 1 , 2 , , 7 ) 

which shows that X = S. is a characteristic vector corresponding to the char¬ 
acteristic value \r ^ d„ of the equation (A - \I)X = 0 Thus the n columns of 
the transforming matrix S are characteristic vectors of the given matrix A More¬ 
over, since the inverse of S exists, by hypothesis, it follows that \S\ 9 ^ 0 Hence, 
by Theorem 10, Sec 10 f), the n columns of S are linearly independent. Thus, the 
matrix A has n linearly independent characteristic vectors, and the necessity 
assertion of the theorem is verified 

Suppose now that A has n linearly independent charactenstic vectors Xi, 
X 2 , , Xn corresponding to the (possibly repeated) characteristic values 

^ 2 , . , X„ Then, by hypothesis, 

AX. = XJX. = X.X. i = 1, 2, . . . , n 
Now, let 5 be the matrix who.se columns are the charactenstic vectors Xi, Xj, 
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. . . , X„; 1 e , let S be a modal matrix of A. Then, Bince the characteristic vectors 
are independent, by hypothesis, it follows that exists, and we can wnte 


= S'^AWXi Xj ■ • • X„|| 

= S-^ WAX, AX, • AX4 
= S-^ lIXiXi \,X, ■ ■ ■ X„X„|| 


= llXi X, 


= 


Xi 


..o 

O Xn 


^-11 


o 


o 



Hence, A is similar to a diagonal matrix; and the sufficiency assertion of the 
theorem is also verified. 


Since every hermitian and every real symmetric matrix has 
n linearly independent characteristic vectors, it is clear that the 
la.st theorem contains the following important special result 


COROLLARY 1 

Every hermitian and every real symmetric matrix is similar to a diagonal matrix 

Using the Schmidt process, it is clear that if a matrix A has n 
independent characteristic vectors, it has, in fact, a set of n ortho¬ 
normal characteristic vectors Moreover, as vve saw in Exercise 12, 
Sec 10.3, a matrix whose columns are orthonormal is an orthogonal 
matrix Plence, taking the matrix S in Theorem 4 to be a matrix 
whose columns are orthonormal characteristic vectors of A, we 
have the following results. 


COROLLARY 2 

Every real symmetric matrix is orthogonally similar to a diagonal matrix 


COROLLARY 3 

If a matrix is orthogonally similar to a diagonal matrix, it is symmetric. 

By essentially the same argument, the following companion results 
for hermitian matrices can be established. 


COROLLARY 4 

Every hermitian matrix is unitarily similar to a diagonal matrix. 
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COROLLARY 5 

If a matrix is unitarily similar to a diagonal matrix, it is hermitian. 

Although not every matrix is similar to a diagonal matrix, every 
matrix is similar to a triangular matrix Specifically, in more ad¬ 
vanced texts* the following results are established: 


theorem 5 

Every square matrix is unitarily similar to a triangular matrix 

theorem 6 

Let the characteristic values of an (n,n) matrix A be Xi, X 2 , , X*, lei the 

multiplicity of Xt be rrit] let r, be the number of linearly independent characteristic 
vectors of A corresponding to X,, and let I), I)c the upper triangular matrix 

in which the diagonal elements arc all Xt, the first m, — f, elements on the diagonal 
above the principal diagonal arc each 1, and all other elements are 0. Then the 
given matrix is similar to the imunx 

Dr 

D= I 

O I 

The standard, or canonical, form described in the last theorem 
IS known as the Jordan canonical form.f 

Many of the theorems of the last two sections find the’r most 
immediate physical application in the analysis of vibiating svs- 
tems, either mechanical or electrical In particular, th? orthogonal¬ 
ity of the characlerisl 1 C vectors of a matiic eciuation make it 
possible to impose initial conditions of displacement and velocity 
on a system vith a finite number of degrees of freedom in a way 
that resembles closely the corresponding procedure for boundary 
value problems involving (‘ontinuous svstems (Secs 8 4 and 8 5) 
The following example illustrates these ideas 



EXAMPLE 1 

Tlie three iniissea shown in Fig J1 la are initiall> displaced so that 
(ii)o = 2 (2-2)0 =■ —1 (2*3)0 “ 1 

From these positions they begin to move with initial velocities 
(fljo * 0 (l»2)o = 2 (1^3)0 “ 0 

Assuming that there is no friction m the system, determine the subsequent motion of ea< h mass 
Since fnetion is assumeii to be m^gligible, the only forces acting are those transmitted to the 
masses by the springs directly attached to them Now, when the instantaneous diHp!a< ements of 
the masses are j,, x^, and xj, the lengths of the springs have changed from tlieir unstretched, 


* See, for instance, L Mirsky, “Linear Algebra," p. 307, Oxford Book 
Company, Inc , New York, 1955. 

t Named for the French mathematician Camille Jordan (1838-1922). 
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FIGURE n.1 
A three-mass sys¬ 
tem m equihb- 
rium and in a 
displaced posi¬ 
tion. 



Net changes m spring lengths (xj, X 3 shown positive, Xj shown negative) 



equilibrium lengths by the respective amounts (Fig 11 16) 

Xi Xi — Xi Xs — Xa — x$ 

Hence, the forces instantaneously exerted by the springs are, respectively, 

3ii 3(x 3 — xi) 3(xi — xa) —Xi 

where plus signs indicate that the springs are m tension, minus signs that the springs are 
in compression Therefore, applying Newton’s law to each of the masses in turn, we obtain the 
three differential equations 



d*xi 

6 -— = -3x, -h3(x,-xt) 

4 ” — 3(x2 — Xi) 4 - 3(x, — xj) 

d^xj 

dr 


or 

( 6 Z)» 4- 6)xi - 3 xj 

= 0 

(5) 

-3x, + (4I>» 4- 6 )x 3 - 

3xa « t) 


-3Ta -h (4Z)* + 4)x3 - 0 

or, in mntric notation, simply 
P(D)X - 0 


where 

P{D) - 

6£>* 4- 6 

-3 

-3 

4D* + 6 

0 

-3 

and 


Xi 

X2 



0 

-3 

4D» + 4 



Xs 


Since there is no dissipation of energy through friction, it is clear that each mass must 
vibrate around its equilibrium position with constant amplitude Hence, as a solution we 


A' 


cos cjt 


that IS, 

Xi “ Oi cos ui Xj = rtj cos oft Xj “ 0 COS o)t 
where w is an unknown frequency and Oi, 03 , and uj are the unknown amplitudes through which 
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the maasee oscillate. Substituting these into the differential equations in (6'> and dividing out the 
common factor cos we obtam the three algebraic equations 

-I-6)fli - 3o, -0 

(6) -3ai + (-4a,* + 6)o, - 3o, - 0 

-3a, + (-4€.»« + 4)a, - 0 

from which to determine ai, a,, and a. This system will have a nontrivial solution if and only if 
the determinant of its coefbcients is equal to zero. Hence, we must have 

(-6a)« + 6) -3 0 

-3 (_4a,i + 6) -3 - -6(4«*-!)(«•- Dvio,* - 9) - 0 

0 -3 (-4«* + 4) 

Thus the system (6) has a nontrivial solution for w* * 1, % ana tor no other valuw of w*. 

The natural frequencies of the physical system are, therefore, 

^ “ H, h ^ 

Now, according to Theorem 8, Sec 10 5, the values of oi, a-j, and a, which satisfy (6) when 
the determinant of its coefficients is equal to zero can be read from any (2,3) matrix of rank 2 
contained in the coefficient matrix Hence, using the matrix of the coefficients of the last two 
equations m the set, we have, in the three nontrivial rases, 


3 

5 

-3 

Ol 


Oi 

a, 


0 

-3 

3 

1 ® 

-3 

-3 

-3| "1-3 

6 




1 -3 

3 

0 

0 

CO 

-8 



3 

a, - 3 





3 

2 

-3 

Oi 


a, 

a, 


0 

-3 

0 

2 

-3 

-3 

-3 " -3 

2 




-3 

0 

0 

0 0 

-3 


02 = 

0 

a, - -1 





3 

-3 

-3 

1 a. 


o. 

a. 


0 

-3 

-5 

1 ~-3 

- 3 ] 

-3 

-3| " -3 

-3 




-3 

-5 

0 

-sj 0 

-3 


O! “ 

-6 

o* “ 3 






Thus we have found three particular solution vectors for the system (5), namely, 

II e II M| II ^11 3 

ATi- 3 |co8- - 0 cos f X,- -5 cos-/ 


2 

1 

1 


2 

3 

cos - X, " 

0 

cos t X| — 

-5 

3 

2 

- 1 


3 


Clearly, if we had begun with the assumptions 
X\ « oi sin ut X 2 ™ a, sin ut 


x% ™ a. Bin (lit 


we would also have obtained the algebraic equations f6) and, hence, the same three values of u 
and the same solution vectors Therefore, we have three more particular solutions- 



2 

1 

1 


2 

X 4 - 

3 

sin - Xj “ 

0 

Bin t X| — 

-5 


3 

2 

-1 


3 


and, finally, the complete solution 

( 7 ) X " cjXi + C7X2 + c,X, + C4X4 + ChXg -b c^Yf 
where the c's are arbitrary scalar coefficients 

To determine the values of the c’s we must, of course, use the given initial conditions. The 
most convenient way to do this is to write the system (6) in the form 

(8) (K - wTM - 0 




500 


FURTHHI PROmnSS OF MATRICIS 


CHAP. 11 


where V — 

6-3 0 

-3 6 -3 

T - 

6 0 0 

0 4 0 

A - 

ai 

ai 


0-3 4 


0 0 4 


ai 


and then recall from Sec 11.2 that the solution vectors of (8), namely, 



2 


1 


2 

Ax - 

3 

A, - 

0 

A, - 

-6 


3 


-1 


3 


satisfy the orthogonality condition 

(9) AjTAi^(^ t9^j 

To take advantage of this property, we first set f — 0 m (7) and substitute the mitial displace¬ 
ment vector for X(0), getting 

( 10 ) 


2 


2 


1 


2 

-1 

- Cl 

3 

+ Cl 

0 

+ C| 

-6 

1 


3 


-1 


3 


Then, if we multiply this equation through on the left by 

6 0 0 

Ai^T « 1|2 3 3|| 0 4 0 - 1112 12 1211 

0 0 4 

the second and third terms on the right vanish because of the orthogonality property (9), and 
we have simply 


||12 12 1211 


2 

-1 

1 


«=c,lll2 12 12|| 


Cl - y4. 


Similarly, multiplying (10) on the left by 

- lie 0 -411 and by AJT \\12 -20 1211 

m turn, we find 

Cl ^ H Cl - Jio 

To find Ci, ci, and Ct we first differentiate Eq (7), getting 

dX 1 

dt ~ 2^‘ 


1 

+ 2^* 


2 

t 

1 

3 

2 

3 

3 

sin-C 2 

0 

sin <-Cl 

-5 

sin - i 

3 

2 

-1 

2 

3 

2 

2 

t 

1 

3 

2 

3 

3 

cos-1- Cl 

0 

cos t -j- - Ce 

-5 

cos - 1 

3 

2 

-1 

2 

3 

2 


dX 

Then, setting t — 0 and replacing ^ ^ by the given initial velocity vector 


L we have 


( 11 ) 


1 


2 


1 


2 

2 

- >^C4 

3 

+ Cl 

0 

+ ^^c, 

-5 

0 


3 


-1 


3 


Finally, multiplying this equation on the left by 

A,^T - 1112 12 12|| X.’T - ||6 0 -4|| and At^T - |112 -20 1211 

m turn, we find 

C4 H Cl - H and c* - -Ho 
With the r’s determined, the solution is now complete, and we have 

X - HXi + HXi -h HoXi -h HXi + HX, - HoXt 
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or, explicitly, 

2* + ‘ + iB^ ^ ^ 

3 t 7 3 9 < 7 3 

X. --cos- eo8-i + -«in- +i“"2 ‘ 

3 t 4 21 3 9 13. 21 , 3 

x..-cos---co8l + -co8-l + -B.n---«nl--».n-l 

We have already identified the three values w *= 1, as the natural frequencies of the syst^em, 

1 e , the only frequencies at which free vibrations of the system are possible, and we have illus¬ 
trated how the motion produced by an arbitrary set of initial conditions involves simultaneously 
vibrations at each of the natural frequencies The vectors A i, A j, a»M^ a s, associated, respectively, 
with the frequencies a> = co - 1 , and u - arc called the normal modes of the system Each 
describes the relative amplitudes with which the three masses would vibrate if the system were 
set in motion in such a way that it vibrated only at the ci'rresponding natural frequency. The 
a/jsolwte amplitudes dejiend upon the c’s, of course, and so are determined by the initial conditions, 
but at each natural frequency the ration of the amplitudes with which the masses oscillate are 
always the same, regardless of their actual numerical values Figure 112 illustrates this behavior 
for one full cycle of the motion at each of the three natural frequencies 

To conclude our discussion, let us now apply to this problem the results of Theorem 3, 
Sec 11 3 To do this, we return to the matric equation (8), namely, (F — u'T)A — O, and 
observe that V and T are both symmetric and that T is positive-definite Hence, the hypotheses 
of Corollary 1 , Theorem 3, Sec 11 .3, are fulfilled, therefore, i{ A*, A^, A* are solution vectors of 
Kq (8) orthonorinal with respect to T and if M is the matrix \\A * A* >41" |1, the substitution 

.Y - MY 

will simultaneously reduce the quadratic forms X'^VX and X'^TX to the respt^ctive diagonal 
forms V^DY and where D is the diagonal matrix of characteristic values 

H 0 0 I 
0 10 
0 0^1 

To verify this, we note first that, when the solution vectors 



2 


1 


2 

Ay - 

3 

A, - 

0 

A, - 

-5 


3 


-1 


3 


are normalized with respect to T, we obtain 

A* ^ 4' „ .” = — 

\/Ay^TAi \/y6 


2 

3 

3 


Hence, the required substitution X ^ MY is 


_ Ai _ 


1 

\/To 







2 

1 

2 

Xl 



Vio 

VTeo 



3 

0 

-6 



\/96 

\/l60 

X, 


3 

-1 

3 



\/l0 

\/l60 
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d7>'^^'mr^ 27r 







oD 7)1)"^+ ■* 




I 

\^^'0Dd'^ 





-^ 0 D 0 0^~~ < 

^0 }) d~ '^ — y ,ii ' 






Relative amplitudes 10-1 


d'dT' 








u = j 

Relative amplitudes 2 3 3 
FIGURE 11.2 

The normal modes of the system shown m Fig. Ill 






-^'■i)-ii'i)'S';;^V3i)iB^] 

|—^6>7)i)' 

— 

-^'dOOc) ' 


\-^D7>'i)'^ 




\~^ili>^ 

l^dddd^ 




^00 ^ D' 


Hw‘” 

0 d0l> 

'^/T 


Hms^V 

DJf o d^ 


^'oiroD 


y-~^~0l)l)^- 




2 

Relative amplitudes 2 - 5 3 


xi - + —^- + 

Vm Vio Vm 


^ _ 3yi _^ 3yi 

Vm Vio Vlio 

Finally, introducing these expressions into the quadratic forms 

X’'VX - 6a.* - 6X|X> + ex,* - ax,x, + 4x,* and X^TX - 6x,* + 4i,* + 4i*' 
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we obtain, respectively, 


and 


x^vx - 6 + -^ + 

\V96 y/lO \/l60/ 

\V96 VlO V160/\V96 Vm/ 

_ 5 / _ 5yi \ / 3yi _ yt ^ 3yi \ 

\V 96 \/m)) v/IS)/ 


+ __yk + -^V 

V \/96 \/l 0 \/T 0 O/ 


1 9 

' - Vi* + Vj' + - ?/»* 
4 4 


\\/m Vfo Vm) \\/96 -v/ioo/ 


+ +-^V 

' 60/ 


\\/90 VlO Vl6oj 


■ Vi* + yi* -f yi* 


In the present problem it is easy to identify the two quadratic forms X'^VX and X'^TX In 
fart, since the energy stored in a spring stretched a distance s is ks^/2, it follows that the instan¬ 
taneous potential energy in our system is 

+ 3(^2 - 2 :,)> -H 3(ja - x,y -h = i^[6r,* - 6 j,x, + 6x,* - Ox,x, + 4x,«l 

- l^X'^VX 

Hence, X'^VX is equal to twice the instantaneous potential energy of the system 

Also, the kinetic energy of a mass moving with velocity v is mv'^12 Hence, the instantaneous 
kinetic energy of our system is 

M(6x,' + 4i,> + 4i,») - 

From this it follows that, when the system is vibrating at any one of its natural frequencies tu», 
its maximum kinetic energy is 

Ci»i* 

— X'^TX 
2 

The new coordinates yi, yj, yi, defined by (12) and in terms of which the two energy 
expressions appear as sums of squares, are known as the normal coordinates of the system. 

EXERCISES 

1 For each of the following matrices A, find two pairs of nonsingular matrices {P,Q) such that 
PAQ ie a diagonal matrix 


a 

111 2II 

b 

111 -ill e 

1 

-1 

1 

d 

1 

0 

3 


II 3 4 II 


CO 

0 

2 

1 

2 


1 

-1 

I 




1 

0 

1 

3 


-1 

3 

3 
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2 For each of the following matnces A, find two nonsmgular matrices P such that P'^AP ib a 
diagonal matrix 


a 

111 2II 

b 

1 ^ “Ml 

c 

1 1 

1 

d 

1 

2 

0 


12 3II 


1 -1 0 II 


1 2 

0 


2 

5 

2 






1 0 

3 


0 

2 

4 


8 For each of the following pairs of matrices (A,B)f find a congruence transformation which 
will simultaneously reduce A and B to diagonal form, and carry out the diagonalization, 


a 1 

3 

- 2 II 

II ^ 

o|| 

b 

II ^ 

2 II 1 

1 ^ 

“II 


-2 

4 II 

II 0 

2 II 


II 2 

2 11 1 

1 0 

ill 

c 1 

4 

3 


111 Oil 


d 

II 2 

2 II 1 

1 1 

1 II 


3 

6 


0 

CO 



II 2 

3 II 1 

1 1 

2 II 


8 

0 

0 

f 

3 

-1 

0 

4 0 

0 

0 

2 

0 


-1 

1 

-1 

0 1 

0 

0 

0 

2 


0 

-1 

5 

0 0 

4 

1 3 

1 

1 

h 

7 

-1 

0 

6 

-2 

1 

3 

-1 


-1 

11 

-4 

-2 

10 

111 -1 

3 


0 

-4 

10 

-1 

-5 


4 a If and B are hermitian (or real symmetric) matrices, show that there may exist con¬ 
gruence transformations which will simultaneously diagonalize A and B even though B is 
not definite. 

b Find a congruence transformation which will simultaneously diagonalize j| ^ J j| 

o|l 

-2i' 

c Find a congruence transformation whicli will simultaneously diagonalize || ^ j| 

j II -7 5 II 

“"'^11 5 -ill 

6 Find similarity transformations which will reduce each of the following matrices to diagonal 
form 


a 1 

-3 

2 II 


b 

0 

-2 

1 

c 

2 

1 

1 


1 

-10 

fill 



-2 

0 

1 


2 

1 

1 


d 

5 

-2 

-1 

e 

2 

-3 

3 

f 


3 

-2 

-2 


-1 

4 

-1 


0 

3 

-1 


- 

1 

2 

0 


1 

-2 

3 


0 

-1 

3 



1 

-1 

1 


1 


1 

2 

and Xo = 

-1 

2 


3 


6 Work Example 1 with Xo 


7 The system shown in Fig 113 begins to move with initial displacement “ 2 



initial velocity i 0 ■ 
subsequent raption 


_ j Assuming that there is no friction in the system, determine its 
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8 The fyetem shown m Fig, 114 begins to move with mitial displacement Jfo " 1 nnd 

-1 I 

1 

initial velocity ,^o ■ 0 . Assuming that there is no friction in the systenn, determine its 

2 

subsequent motion 

H *1-6 mi - 8 *,2-2 m2" 2 *13-1 m3 - 2 *3-1 || 


9 The system shown in Fig 11 6 begins to move with initml displacement F — 0 and 

2 

mitial velocity F «- 1 Assuming that there is no fnction m the system, detormine its 

1 . 

subsequent motion 


/i - 40 /2 - 12 /g - 18 



11.4 

Functions of a square matrix 

In Sec. 10.2, after we had defined matric multiplication, we were 
able to define positive integral powers of a square matrix A and 
to verify that, for arbitrary positive integers r and s, 

A^A* = *= 


( 1 ) 




506 


FURTHER PROPERTIES OF MATRICES 


CHAP, n 


Moreover, we verified in Sec. 10 3 that, if A is a noiisingular 
matrix, it has an inverse A~^ such that AA-^ = A~^A = /, and 
we defined negative integral powers of A by the relation 

A— = (A"0 ” 

Thus, after we introduced the definition A® = /, it became clear 
that, for any nonsingular matrix A, Eq. (1) holds for all integral 
values of r and 8 It is now natural to define polynomial functions 
of a square matrix and, if possible, rational fractional functions 

DEFINITION 1 

A polynomial function of a square matrix A is a finite linear combination of non- 
negative integnil powers of A, 

p(A) = aoA” 4- uiA"'* 4- 4- a„_iA 4- a„/ 

EXAMPLE 1 


If 

then 


A 


1 2 
3 -4 


and p(x) = z* -f -}- 4 



7 -6 


1 2 1 


1 1 0 

1 

= /l» + 5^ 4- 4/ = 

4 r> 


+ 4 

1 * ^ 


-9 22 


3 -4 1 

|0 1 



i|; 

C i; 


It IS interesting to note that p(A} ran also be evaluated by using the factored forms of pfi), 
namely, 


p(x) = (x + 4)(x -f 1) * (x + l)(x + 4) 


p(A) = (d + 4/)(d 4- I) 


piA) = M + 1)(A + 4/) 


■dl: 

^ II ^ 

Vih -4 


-+ 4 


5 2 

2 2 _ 

16 

4 

3 0 

3 -3 

6 

6 


2 2 
3 -3 


1 

0 

15 2 I 
3 0 


: :ll) (; 

; 1 ) (111 


2 

-4 


16 4 
6 6 


:ii) 


In this example it is of course not clear, especially in view 
of the noncommutative character of matric multiplication, 
whether the fact that p(A) can be computed equally well from 


A2 + 5A 4 4/ (A 4- 4/)(A 4- /) and (A 4 7)(A 4 4/) 

is a result of some special property of A and p(x) or is illustiative 
of some general principle Actually the latter i.s the case, in fact, 
any identical relation involving sums and products of scalar 
polynomials is valid for the corresponding matric polynomials, 
as the following important, but almost obvious, theorem assures us 
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theorem 1 

Any polynomial identity between scalar polynomials implies a corresponding 
identity for matric polynomials, 

PROOF Clearly, any polynomial relation between scalar polynomials can be 
constructed using only the operations of addition and multiplication. For instance, 

IS completely equivalent to the chain of relations 

4>(x)f^{x) -= f,{x) 4^{x) = Hx) -f Uix) Hx) = !Mj,{x) 

Hence, to prove the theorem it is sufficient to show ths* for ai^y polynomials 
Q, P square matiix A, 

a lf/(x) -h g{x) = s{x), (hen f{A) + g{A) = .s(A) 
b Tf/(x)fif(:r) = p(x), then/(A)gi(/1) - p{A) 

To prove the first of these, lot 

m n t 

f{x) = y g{x) =- V h,r^ 5(j) = ^ c.x’ 

^Z:0 t-:0 t-o 

where t ~ inax(?V7,n), c, = a, f th, and the cocHicients of any powers of r which 
are not present are understood to he zero Then 

m n 

f(A) = I a,A‘+ I bJ' 

,-0 .-0 

f t 

X "" S as asserted 

,-o »-o 

To prove part b, let 

m ^ ^ 

/(r) - y a,x' g(x) - Y h,x> p(x) = ^ 

t - 0 / “ 0 In “ 0 

wliere t ~ vi ti and ca ~ ^ 1^'’ summation extending over all valu(‘H of 

i and j such that i -{- / = k and, of course, 0 ^ ^ 0 ^ j ^ llum, using 

tile distributive pioperty of matric multiplication and the a.ssoeiative and com¬ 
mutative properties of iiiatnc addition, v,e have 


f(A)g{A) =- ( I a.A') ( ^ bjA’) 

t=0 ;“0 

= y V {a,A'mA’) = I I 

v-Oj-0 

or, grouping together all terms involving the same power of A, 

/-m + n 

f(A)g{A) - y CfcA* where fc = t -f ; and Ck = 2 ^ a^bJ 
k~o 

= p(A) as.serted 

Since f{x)g{x) = g{x)J{x), it follows from Theorem 1 that 

(2) !{A)g{A) = g{A)}(A) 

In other words, we have the following important result. 
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COROLLARY 1 

Any two polynomials in a matrix A commute with each other. 

If g(A) 18 a nonsingular matrix, then exists, and we 

may premultiply and postmultiply each side of Eq. (2) by g~^(A), 
getting 

0 -HA)f(A)g(A) 0 -^(A) = g-^(A) 0 (A)f(A)g-^(A) 
or 

(3) g-^(A)f(A) =/(A)rHA) 

With this identity, we are now in a position to define rational 
fractional functions of a square matrix A 

DEFINITION 2 

If/(a:) and g{x) are scalar polynomials and if A is a square matrix such that g{A) 
18 nonsiiigular, then either of the equal matrices g-HA)f(A) i\nd f{A)g~'^{A) is 
called the quotient of/(A) by g{A) and is written/(A )/^(A). 

It IS now relatively easy to prove the following extension 
of Theorem 1 (see Exercise 3), 


THEOREM 2 

Any identity between rational fractional functions of a scalar variable implies a 
corresponding matne identity, provided all the matne functions are defined 

With rational functions of a square matrix now defined, it is 
natural to ask whether the characteristic values of a rational 
function of a matrix A can be expressed in terms of the charac¬ 
teristic values of A. This is indeed the case, as the following 
chain of theorems makes clear. 


THEOREM 3 

If Xi, \z, . . . , \n are the (possibly repeated) characteristic values of a square 
matrix A and if f is any polynomial, then 

\f(A)\ = /(X.)/(X,) • ■ /(X„) 

PROOF Let the charactenstic polynomial of the given matrix A be 

n 

(4) \A - X/| = n 

1-1 

and let the factored form of the given polynomial / be 

(5) fit) = c(< - ri)(< - rz) • • (f - r*) 

Then, since Theorem 1 assures us that identities between scalar polynomials 
imply corresponding matne identities, we have 

fiA) = ciA - rJ)iA - rzl) ■ • (A - rj) 

Furthermore, since the determinant of a product of square matrices is equal to 
the product of the determinants of the matne factors, and since the scalar factor c 
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incorporated into any one of the matric factors reappears as the factor c" m the 
determinant of that matrix, we have 

k 

(6) I/(A)1 = c"|A - r,7| \A - r,7| • • \A ~ rj| = <•» fl “ r,I\ 

However, 1^4 — is just the characteristic polynomial of A evaluated for 
X = Tj Hence, by (4), 


\A - r,I\ = n (X. - n) 

1-1 

and, therefore, substituting into (6), wc have 

k n 

i/(A)i = r" n n IX. - 

j = i .-1 

Next, interchanging the order in whicli the products are formed by first grouping 
together all the factors corresponding to a giveri value of i and assigning a single 
factor c to each such group, we have 

n k n k 

i/(A)i = f" II n (X. - r,) ^ n n (x. - f-j)] 

..1j-i ,-1 - 

Finally we observe that, with the coefficient c, the inner product, in the last expres¬ 
sion IS prec 'ly the evaluation of the factored form (5) of the given polynomial 
for t = Xv Hence, 

\M)\ = n /(Xt) as asserted. 

1-1 


THEOREM 4 

If ^ 1 , ^ 2 , . . , An are the characteristic values of a square matrix >1, if / = g/h 

IS a rational fractional function, and if \h{A)\ is diiTercnt from zero, then 

|/(^)| -/(Ai)/(A 2) • /(An) 


PROOF Since, by definition,/(^) — ^(/4)//i(A) = g{A)h ^{A) and since the 
determinant of a product of square matrices is equal to the product of the deter- 
miiiiints of the matric factors, we have 


|/(A)| = |(;(A);i->(A)| = \g(A)[ |;i->(A)| 

Moreover, as we observed in Sec; 10 3, ^ l/l/i(A)| Therefore, 

I f(A) I — " ^ - 

However, by Theorem 3, siciec g and h are polynomials, 

|p(^)l = i 7 (Xi)ff(X 2 ) p(Xn) and |A(A)1 = h{\i)h{\i) h{K) 

g{K) 

h(.K) 

= /(Xi)/(X 2 ) /(X.) as asserted 


Hence 


- sT^Sisr 
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THEOREM 5 

If Xi, X 2 , . . . , \n are the characteristic values of a square matrix A and if 
/ = 9/^j where g and h are polynomials such that |^(-4)| ^ 0, then the charac- 
teristic values of/(A) are/(Xi), /(X 2 ), • . ,/(Xn). 


PROOF Let 


0(x) = f{x) - X 


= ~ Xfe(x) 

h(x) h(x) 


Clearly, g(x) — \h{x) is a polynomial, and, therefore, <^( 2 :) is a rational fractional 
function of x. Hence, by the last theorem. 


l0(A)| = </»(Xi)^(X2) ■ • ^(X„) 


In other words, for all values of X, 


|/(A) - X7| = [/(Xi) - X][/(X2) - X] • [/(X„) - X] 

The right-hand side of this identity is, thus, the factored form of the characteristic 
polynomial 1/(A) — X/j of the matrix/(A); hence, the roots of the characteristic 
equation of/(A) are 

X =/(Xi),/(X 2 ), . . . ,/(X„) as asserted 


COROLLARY 1 

If the characteristic values of a matrix A are Xi, X 2 , , X„, then for all integral 

values of k if A is nonsiiigular and for all nonnegative integral values of /c if A 
singular, the characteristic values of A^ are Xi*, X 2 *, , Xn* 


COROLLARY 2 

If X, is a characteristic vector corresponding to the characteristic value h of n 
square matrix A and if p is a polynomial, then X^ is also a characteristic vectoi 
corresponding to the characteristic value p(Xt) of the matrix p(A). 


EXAMPLE 2 

As an illustration of Theorem 5, consider the matrix A 
1/(1 + 3) The characteristic equation of A is 


1 

3 


-2 

-4 


and the function 0 (j) = 


lA - X/| - 



+ 3X + 2 » 0 


Hence, the characteristic roots are X «= —1, —2 Therefore, according to Theorem 5, the char¬ 
acteristic roots of <t>(A) are 


<^( — 1) - and —2) - —2 

To confirm this, we have, by direct calculation, 


<KA) 


A 

A +31 


- AU + 3 /)-‘ - 




11 

- 2 


4 

-2 

-J 

1 3 

-4 


3 

-1 


1 

-2 


.1 

-1 

2 

3 

-4 

H 1 

-3 

4 

1 ^ 

-6 

II _l 

H ■ 

-3 

9 

-10 

II 

1 

H ■ 

-5 
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The characteristic roots of ^(A) aie, therefore, the roots of the equatim 


1^4) - X/1 - 
or - 1 2 — 2, as before 


H - X 



- x> + Hx + J 


0 


If p is a polynomial and ^4 is a square matrix, the evaluation 
of p(A) IS a perfectly straightforward matter However, when 
A is a matrix similar to a diagonal matrix, the evaluation of 
p(A) can be appreciably simplified. To establish the result upon 
which this simplification is baaed, it is convenient first to prove 
the following lemmas 


LEMMA 1 

If 5 = then B- = S-^A\S 

PROOF Clearly, the lemma is true f^r n ~ 2, since 

- (S-^AS)(S-^AS) = S-^A(SB^')AS = S^^A^S 
Assuming, then, that the lemma is true for n - k, we have 

5^+1 = BB^ = (S'\iS){S-^A>^S) = S"'A{SS'^)A^S = S-^A^S 
which completes the induction and establishes the lemma 

If ^\e now apply Lemma 1 to each term of any polynomial 
function of B and then use the distributive property of matric 
multiplication, we obtain the following result* 


LEMMA 2 

Ji B = S~^AS and if p is a polynomial, then p{B) = 5~^p(A)5, i e., 
p(S- ^AS) = S-^p{A)S 

Furthermore, by another easy induction we can establish the 
following observation 


LEMMA 3 

If D IS the diagonal matrix 


, o 

(122 

1 

then = 

■'"* ,. o 

dnn 1 

1 

O 


Finally, by applying Lemma 3 to each term of any poly¬ 
nomial function of a diagonal matrix D and then using the 
definition of matric addition, we have the following result: 


LEMMA 4 

If D 18 the diagonal matnx 



C3 
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and p is any polynomial, then 

p(rfii) Q 

p{D) = 

O 

Using Lemmas 2 and 4, we can now prove the following 
useful theorem- 

THEOREM 6 

If a matrix A is similar to a diagonal matrix; i e , if 

X, O 
S-'AS = Z) = ’ 


where Xi, Xj, . . . , X„ are the characteristic values of A, then 

IO II 


P(A) = S 
PROOF By Lemma 4, 
P(D) = 


p(Xj) 

O P(^") 
p(^.) o 

P(X,) ^ 


Also, since S^'AS = D, it follows that A = SDS"' Hence, using Lemma 2, we 
have 

P(Xi) Q 

S = Sp{D)S-' = p(SDS -') = p{A) as asserted 


EXAMPLE 3 

If p(i) — — 4i* -1- 6i* — a- — 3 and A 


0 -2 

, what 18 p(4)? 


Ill 3ir 

By an easy calculation we find the characteristic equation of A to be 


-X -2 
1 3 - X 


X* - 3X + 2 - 0 


Hence, the characteristic values of A are Xi - 1 and X, - 2; and, since these arc distinct, it 
follows from Theorem 4, Sec 11 3, that A is similar to a diagonal matrix and Theorem 6 can be 
applied Now, corresponding to Xi and Xj we have the characteristic vectors 



2 



1 


and 

Xt - 


-1 



-1 


and from these we can construct the modal matrix 



2 1 

and its inverse 


1 1 


- 


-1 -1 



-1 -2 
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According to Theorem 4, Sec. 11.3, these are matrices such that 
S-'AS - O - I ^ ° I 

Hence these are the matrices to be used in evaluating piA) by means of Theorem 6 . Now, 
pM - p(l) - -1 and p(X,) - p(2) - 3 

Therefore, 

pM) - + 6A* - A - 3/ - 

- II 2 1 

" II -1 -1 
-II”® -8 

" II 4 7 

After polynomial functions of a square matrix have been 
defined, it is natural to consider polynomial equations in a matric 
variable In particular, now that we have developed procedures 
for evaluating p{A), that is, solving the equation p(A) = X, we 
shall consider the problem of solving the nontrivial equation 
piX) = A. where p is a given polynomial, A is a given square 
matrix, and is a matric vanable. By means of examples (see 
Exercise 1) it is easy to show that there are polynomial equations 
piX) = A which have no solution In one impiortant case, how¬ 
ever, the equation p{X) = A can always be solved, as the follow¬ 
ing theorem makes clear: 



THEOREM 7 

If A 13 similar to a diagonal matrix and if p is a scalar polynomial, the equation 
p{X) = A is solvable for X 

PROOF By hypothesis, since A is similar to a diagonal matrix D, there exists 
a nonsingular matrix S with the property that S~^AS = D, or A = 
where, say, 



(Z) 


Now, let f< be one of the roots of the equation p(i) = d,*. Then, if 


- o 

O ' 

ws have, by Lemma 2, noting that S 


and X - SRS-' 




3»(JC) - p(S«5->) - Sp{R)S-' 
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Moreover, by Lemma 4 and the fact that p(r,) = 


p(«) = 

P(r.) 0 

P(rs) ^ 


■ 0 


0 P(’'») 


0 dnn 


= D 


Therefore, p(X) = Sp{R)S-'^ = SDS-^ = A 


which proves that, if A is similar to a diagonal matrix, then p{X) = A has the 
solution X = If the polynomial p is of degree k, the scalar equation 

p(x) = d^^ has, in general, k distinct roots. Hence, there are k distinct choices 
for each of the n diagonal elements in R, and, therefore, p(X) = A has, in general, 
at least fc" different solutions. 


By applying the preceding theorem to the particular equa¬ 
tion X* = A, we obtain the following corollary 


COROLLARY 1 

An (n,n) matrix with distinct characteristic values has at least 2" or 2" "^ distinct 
square roots, according as it is nonsingular or singular 


PROOF Let A be an (n,n) matrix with n distinct characteristic values Xi, X 2 , 
. . . , Xn. It follows, then, by Theorem 4, Sec 11.3, that there exists a nonsingular 
matrix S such that 


Xi 


A = S 


o 


o 


Xn 


S ’ 


Thus, according to the last theorem, for any choice of plus and minus signs, 

± vr, O 


X = s 


± Vxj 


o 


+ 


s- 


satisfies the equation X^ = A If A is nonsingular, none of the X’s is zero, and 
there are 2" combinations of signs each leading to a different matrix X satisfying 
the equation X* = A On the other hand, if A is singular but still has distinct 
characteristic values, then, by Theorem 5, Sec 11.2, one and only one of the X’s 
must be zero, and, therefore, for one of the diagonal elements there is only a 
single choice rather than two Hence, in this case there may be no more than 
distinct square roots, as asserted. 


EXAMPLE 4 


Solve the equation X* — AX -|- 4/ — 


4 3 

5 6 


The characteristic equation of the matrix A 


4 - X 3 
6 6 - X 


4 3 

5 6 


IS 


- X* - lOX + 9 - 0 
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Hence, the characteristic values of A are Xi * l, Xj ■ 9, and the corresponding characteristic 


1 

Xa - 

3 

-1 

1 * 

\f 

5 


vectors are Xi 
diagonal matrix; that is, 

S~^AS - Z) or 


Therefore, by 'Fheorem 4, Sec II 3, A is similar to a 
A - SDS-i 

>j II II I ii 

Wo must now 


where S is the modal rnatnx 

1 ^ ^ 

1 5-1 - 1 ^ ^ 

and D “ 

1 0 


1 — 1 5 

L ! 1 1 


0 9 


r» - 4r + 4 = dn - 1 r* - 4r -f- 4 « d*: - 9 

I - r, - 1, 3 j - rj - -1, 5 

Pairing each possibility for ri with each possibility for r^, we th’i'* uDtain four possibilities for 
the matrix R 


Ri - 

1 0 

II 


CO 

1 

0 


c 

1 

i 1 

0 r.i |o -1 

llo 

5 


'Pheri, according to Theorem 7, the solutions of the given equation arc 
Xi - « 

and, similarly, 

X 2 = SRiS- 



1 3 

ill 

0 

.-is -3 

1 

-3 


-1 5 1 

||0 

1 

111 1 '* 

-5 

- 1 1 


5 3 

-Y. - SR^S-' - <4 1 ^ ^ 

6 7 

1-5 1 


Xi - SRiS~^ - ^4 


15 3 

6 17 


EXERCISES 

1 Prove that there is no matrix which satisfies the equation X^ “ 

2 Show that, for particular polynomials and particular matrices, ea/;h of the following cases is 
possible 


0 1 
0 0 


a A nonsingular, p(/I) nonsingular b A nonsmgular, pf.4) singular 

c A singular, p{A) nonsingular d 4 singular, p{A) singular 

3 Prove Theorem 2 [Hint Note first that it is sufficient to prove that 


fM 

Uix) ^ f,ix) 

^ Mx) 

implies 

/.(A) /.(A) 

_/6(A) 

’ Ux) 

MA ) /4(A ) 

“/.(A) 

hix) Mx) 

Mx) 

implies 

f^iA) /af.l) 

_MA) 

Mx) Mx) 

“ Mx) 

hi A) UA) 

~ MA) 

/j(x)//2(x) 

^Mxj 

implies 

MA)/MA) 

MA) 

Ux)/Mx) 

Stix) 

MA)/f,iA) 

“ MA) 


Then clear of fractions m the scalar identities, use Theorem 1, and multiply the resulting 
rnatric identities by the appropriate inverses ] 

^ If X 18 a diagonal matrix and p is any scalar polynomial, show that pi A) is also a diagonal 
matrix 

® If i4 18 a diagonal matrix and/is a rational fractional function, isfiA) necessarily a diagonal 
matrix? 

® Show that I 2 has infinitely many distinct square roots 

^ Prove that an (n,n) matrix with distinct charactenstic values has no square roots other than 
those identified by Corollary 1, Theorem 7 (Hint Use the result of Exercise 6, Sec 10.2.) 

8 Prove CJorollary 2, Theorem 5 [Hint' First prove the assertion for the special polynomials 
P(‘d) -■ j 4* by premultiplyiDg the equation AX, « X,X< by A, A*, . , A*“*, m turn.] 
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9 By actually constructing an infinite family of solutions, show that each of the following 
matnc equations is satisfied by infinitely many matrices: 


a X* - 2Z - 3/, - 0 
c A:« - 4X - 67, - 0 


b - 4J!f + 37, - 0 
d X* - ex* + nX -67,-0 


10 Without attempting to find the solutions, show that, for all values of a and b, the equation 
X* -b aX + i>7, - 0 is satisfied by infinitely many matrices What do you think is the 
generalization of this result to equations in an (n,n) matnc variable? 

11 Show that the following matnc equations have no solutions: 


1 

CO 

1 

1 

m 

-4 

0 

1 

-4 

b X* - 4X + 3/, - 

-1 2 

0 -1 

2 0 

1 

c X* - AX - bit ^ 

-9 

3 

d X* - 4X + 3/, - 

1 -1 

0 

0 

-9 

o 

o 

1 

-1 


12 If A and B commute, show that A commutes with any polynomial in B 
18 Verify each of the following identities for X — | 

a {X - I)' • X* - 2X + I 
2X I I 



1 2 

and X - 

0 2 


1 3 


0 -2 


b - 7 - (X - 7)(X* + X + 7) 
X* „ . _ . 47 


X*-7 X - I ' X I 


X - 27 


- A' + 27 + 


X - 27 


14 If i4* — 0 for some positive integer k, prove that every characteristic value of A is zero 
16 Solve each of the following matnc equations: 


a Jf* - 6X + 37 - 


X* - 


1 -4 

2 -5 


b + 97 - 


-6 9 
-6 10 


-6 14II 


8 

-7 

-7 

-7 15II 

d X* ^ 

-9 

10 

11 



9 

-9 

-10 


16 If fix) — x/ix + 4), compute fiA ) for each of the following matrices A 


a 

1 -4| 


b 1 

4 -1 1 

c 112 -1| 


2 -5| 


1 

6 -1 1 

CO 

1 

d 

-3 

1 0 

e 

1 

to 



1 - 

4 0 


2 -1 -2 



0 

0 -6 


-2 2 3 



17 If p(j) - — j* — 3j> + 4x -f 2, evaluate p(i4) for each of the following matrices A' 


a 

4 

Ml 

b 

-1 

-2 

c 

4 

6 


-3 

oil 


3 

4 


-3 

-5 

d 

-4 

-9 

-311 e 

2 

1 

1II 




1 

4 

1 

1 

4 

3 




3 

3 

2 II 

-1 

-1 

oil 




16 Verify that the characteristic values of /(j 4 ) are equal to /(X.) for each of the following fu”®' 
tions and each of the given matrices* 


a - 2x + 3 

i II -1 -411 
2 -61 


b j* - 4x + 3 

ii 1|4 -1 

6 -1 


c I* + I* + * 4- 1 

m 1|2 1 
1 2 
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19 Verify that the characteristic values of f{A ) are equal to /(Xj for each o' the following func¬ 
tions and each of the given matrices 


z 

b 


z* + 1 

X -b 2 

® T' +x ■¥ \ 

II ^ II 

ii II 4 2|| 

iii II 5 2 II 

II -1 2 11 

|i all 

II 2 2 II 


20 If p 18 a polynomial, is it possible for p(.'l) to have a characteristic vector Wi ;ch is not a 
characteristic vector of A? Justify your answer 


n.5 

The Cayley-Hamilton theorem 

Sincr a square null nuitrrc. being a <liagonal matrix, is obviously 
similar to a diagonal matrix, it follows from Theorem 7, Sec 114, 
that the equation p(X) -- 0 is always solvable On the other 
hand, it is not immediately evident that, given a square matrix A, 
there is always a polynomial eipiation with scalar coefficients 
p{X) = 0 of which A IS a solution This is the case, however, 
and it IS noi difficult to show^ (sec Exerc.se 1) that any square 
matrix of older n satisfies a polynomial equation whose order 
is at most In fact, fo'* any square matrix A, there is always a 
polynomial equation of order n whieh is satished by A 

To prove this, it is convenient to prove first a preliminary 
result eoncerning polynomials whose coefficients are not scalars 
but square matrices Before we ran do this, however, il is neces¬ 
sary that we define what is meant by tlie value of such a poly¬ 
nomial, say 

F(\) = Co -h CiX -h H- CfcX^ 

when a square matrix A is substituted for the scalar variable X 
Since niatric multiplication is not commutative, it is clear that, 
in general, the various powders of A will not commute with the 
coefficient matrices in F(X) Hence, although it is true that 

Co -|- CiX -|- -h CaX* = Cc + XCi -h ■ • + X'^C* 

the corresponding matric relation, namely, 

Co + CiA -f- -h Cii4* = Co + i4Ci + ' A*Cjk 

is in general false Thus it is necessary for us to assign a meaning 
to F(A), and this we do by agreeing that 

F(A) = Co 4- CiA -h • -b C*A* 

Now we have already seen (Theorem 1, Sec 11 4) that 
identities relating scalar polynomials imply corresponding identi¬ 
ties when the scalar vanable is replaced by a square matrix. 
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This is not true, however, for identical relations involving poly¬ 
nomials with matric coefficients. For instance, if 

F(X) = Co "h CiX and C(X) = Z)o + D\\ 

then, for the product F(X)C(X), we have 

P(X) = CoDo -f (CoDi + CiDo)X + CiDiX* 

On the other hand, if we replace the scalar X by a square matrix A, 
we have 

F(A) = Co + CiA GiA) = Do + D,A 
and F{A)G(A) = CoDo -h CoD^A + CjADo -h CiADiA 
which is not equal to P(A) unless 
ADo = DoA and ADi = DiA 

However, we cau prove the following theorem, which is the ne<'cs- 
sary preliminary result we mentioned above 


THEOREM 1 

If F(\) and P(X) are polynomials m the scalar variable X with coefficients which 
are square matrices and if P(X) = P(X)(A — X/), then P(A) = 0 

PROOF In view of the fact that we have just seen that P(X) = P(X)(7(X) does 
not imply that P(i4) - P(A)C(A), we cannot prove this theorem simply by sub¬ 
stituting A for X in the assertion of the theorem Instead we must first multiply 
out the right-hand side of the given relation, express it as a polynomial m X, arid 
then replace X by A. To do this, let us suppose that 

F{\) = Cq CiX + C2X^ 'b ■ ’ H" CifcX* 

where Co, Ci, C 2 , . . , C* are (n,w) matrices Then 

P(X) = (Co -h CiX + CaX^ -h • -h C*X'')(A - X/) 

= CoA - 1 - CiAX -f C2AX* + + C*AX* 

- CoX - CiX^ - • - CViX* - c\x‘+‘ 

= CoA -h (CiA - Co)X 4 - (C2A - COX'* -h 

-f (C,A - C.-OX'^ - 

Now, substituting A for X, we have 

P(A) - CoA -h (CiA - Co)A + (C2A - Ci)A^ + 

+ (C*A - C*_i)A* - C*A*-^‘ 

= 0 as asserted. 

We are now in a position to prove one of the most important 
results in the theory of matrices, the famous Cayley-HanuTton 
theorem: 
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theorem 2 

Every square matrix satisfies its own characteristic equation. 


PROOF Let A be an (n,n) matnx whose characteristic equation is 



flu — X 

ai2 

din 

II 

1 

^21 

CLii — X 

din 


f^nl 

an2 

a„n — X 


= (-l)IX" - • -h (-l)"/3„] = 0 


The adjoint of the matrix A ~ \I is clearly an (n,n) matrix wtiose elements, 
being the cofactors of the elements of the determinant \A — X/j, are polynomials 
in X; that is, 


adj {A — X/) = 


Pll(X) 

Pl2(X) • 

Pln(X) 

P^i(X) 

Pn(>^) 

P!.(X) 

7^nl(X) 

P.2(X) 

P.n(X) 


Furthermore, from ihe definition of matric addihon, it follows that the last matrix 
can be written as a polynomial in X, say E(X), whose coelficienTs are (r?,n) matrices, 
the element m the ith row and jth'column of the matric coefficient of X*' being 
the coefficient of X^ in p,j(X) Now, from (lorollary I, Theorem 1, Sec 10 3, we have 


that IS, 


adi (A — X/) {A — X/) = \A ~ X/|/ 

= (-1)"|X"7 - ^iX- >7 -h • -f (-ir^nl] 

(-I)'IXV - ^iX" *7 H- 4- - F{\){A - X/) 


But this is a relation between polynomials in X with matric coefficients of pre¬ 
cisely the type covered liy Theorem 1 Hence, the left-hand side must vanish 
when X = i4 In other words, 


A- - + + (-1)"/J„7 = 0 


that IS, the matrix A satisfies its own chaiacteristic equation, as asserted 


Using the Cayley-Haniiltoii theorem, the mh power of any 
square matrix A can be expressed as a linear combination of 
lower powers of A Hence, by repeated applications of the Cayley- 
Hamilton theorem, any po.si‘ive integral power of A and, there¬ 
fore, any polynomial in A can be expressed as a polynomial in A 
of degree at most n — 1 Moreover, if A is nonsingular, then A~^ 
exists, and, in the expansion of \A — X7|, the constant term = 
\A\ IS difTerent from zero Hence, we can multiply the Cayley- 
Hamilton equation 

A" - -f ' 

by A"^, getting 

+ ■ •+ = 0 
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whence, solving for we find 

A-> = [A"-> - M"-' + ■ ■ + 

Pn 

In some cases this is a convenient method of obtaining the inverse 
of a matrix A 

EXAMPLE 1 

-4 5 5 

If A — —6 6 5 we find by an easy calculation that 

-5 5 6 

\A - X/| - -X> -h 8X* - 13X 4- 6 
Hence, by the Caylcy-Hamilton theorem it follows that 
A' - 4 13A - 6/ = 0 

as can easily be verified by direct calculation Using this relation, we can now express higher 
powers of A as quadratic polynomials in A For instance, 

A^ - A A> =« A(8A» - 13A + 6/) 

- 8A» - 13A* + 6A 

- 8(8A» - 13A + 67) - 13A» 4- 6A 

- 51 A* - 98A + 487 

and A“ = A A" » A(51A* ~ 98A + 487) 

- 51(8A> - 13A -f 67) - 98A» + 48A 

- 310A* - 615A 4 3067 

Similarly, multiplying the Cayley-Hamilton equation through by A" ‘ and then solving for A " *, 
we find 

A-> - ^t((A» - 8A + 137) 

-4 5 5 1 0 0 |\ 

8 -5 6 5 4 13 0 1 0 I 

-5 5 6 0 0 1 1/ 


The Cayley-Hamilton equation is not necessarily the poly¬ 
nomial equation of lowest degree satisfied by a given square 
matrix. For instance, it is easily verified that the matrix A in tin* 
last example satisfies not only the Cayley-Hamilton equation 

i4» - SA^ -h 13^ - 6/ = 0 

but also the simpler, quadratic equation 

A* - 7A 4- 6/ = 0 

DEFINITION 1 

If A is a square matrix, any polynomial p with the property that p(A) — 0 is 
said to annihilate A. 



35 

35 

( -35 

36 

35 

\ -35 

35 

36 


11 -5 -5 

5 1 -5 

5 -5 1 
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Let us now consider the set of polynomials of minimum 
degree which annihilate a given square matrix A, and, for 
definiteness, let us assume that by multiplying them by suitable 
constants their leading coefficients have been made equal to 1. 
Clearly, all these polynomials are identical In fact, if this is not 
the case and if there are two such polynomials / and g, then 
^ is a polynomial whose degree is lower than the degree 
of / and g such that 

h{A) =f(A) - g(A) = 0-0 = 0 

But, by hypothesis, / and g are polynomial annihilators of A of 
minimum degree. Hence we have a contradiction unless h is 
identically zero, that is, unless / and g are the same. 

We are thus ju.stified m introducing the following definition: 


DEFINITION 2 

The unique polynomial with leading coefficient 1 and of minimum degree which 
annihilates a scjuare matrix A is called the minimum polynomial of A. 

Among the properties of minimum polynomials, the follow¬ 
ing are worthy of mention here 


THEOREM 3 

Similar matrices ’■•avc the same minimum polynomial 

PROOF Let A and B be similar matrices, so that B = S~'^AS Then by Lemma 
2, Sec. 114, for any polynomial p, 

p(B) = S-^piA)S 

From this a\o conclude that any polynomial which annihilates A also annihilates 
B, and conversely Hence, the minimum polynomials of A and B must be the 
same, as asserted 

THEOREM 4 

The minimum polynomial of any square matrix A is a divisor of any polynomial 
which annihilates A. 

PROOF I..et the iniriiinum polynomial of a matrix A be f{x), and let 4>(x) be 
any polynomial with the property that <^(A) = 0 Then, by the division algorithm 
of elementary algebra 

0(j:) = q{x)f{x) -h r(x) 

where the remainder polynomial r(x) is either identically zero or of lower degree 
than the divisor polynomial/(x). Then, by Theorem 1, Sec 11.4, 

0(A) = q(A)f(A) -H r(A^ 

However, by hypothesis, 0(A) = 0 and/(A) = 0, Hence, r(A) = 0, and, there 
fore, r{x) is identically zero, for, if it were not, then it would be a polynomial 
which annihilated A and whose degree was less than the degree of the minimum 
polynomial of A, namely,/(x) But if r(x) = 0, then the minimum polynomial is a 
factor of 0(x), as asserted 
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THEOREM 5 

If the characteristic roots of a matrix A arc all distinct, then the characteristic 
polynomial and the minimum polynomial of A are the same, except possibly for 
sign. 

PROOF Let yl be a matrix with distinct characteristic roots X], A 2 , . . , Xn, 

and let the characteristic polynomial of .4 be 

/(X) = (Xi - X)(X2 - X) • (X„ - X) 

Then, since the minimum polynomial of A, say ^(X), must be a factor of/(X), it 
follows that, if/(X) and ^(X) differ in more than sign, then ^(X) must be the prodiit t 
of some but not all of the factors of/(X) Specifically, suppose that ^(X) does iiol 
contain the factor (Xt — X) Now, by Theorem 5, Sec 114, the characterisl ic 
roots of the matrix g{A) are < 7 (Xi), f 7 (X 2 ), , ^(X„) However, since g{\) docs 

not contain the factor (X, — X), it follows that j 7 (X.) ^ 0 Hence, g{A) has at leasl 
one nonzero characteristic root. But, if this is the case, then g{A) is not a null 
matrix; that is, g(A) 0, contrary to the hy]K)thesis that g is the mininunii 
polynomial of A. This contradiction shows that/(X) and < 7 (X) cannot differ exce])! 
possibly in sign, and the theorem is established 

As an Intel psting application of the theory of the rniniininn 
polynomial of a matrix, we have tlu^ following lesnlt 


THEOREM 6 

If A IS a square matrix and if f(x) and g(r) are scalar polynomials such that g{ 1) 
is nonsingular, then f{A)/g(A) is e(pial to a'polynomnd in A 

PROOF Since, by definition, /(y1)/(;(A) = f{A)g~^{A), it is clearly suflicieiil 
to prove that g ^{A) is a polynomial in A To do this, lei 

0(j) = O’* -f -f Ck 

be the minimum polynomial of the matrix G = g(A) Then 

4>{G) = G^ -b c.G^^ ' + A- c, ,G A- cj = 0 

and from this, by multiplying through by G^^ and tiausposing, we obtain 

c,G-^ = -{G^-^ -f- + -b a-i/) 

Now Ck 7^ 0, for otherwise the right-hand side of the last equation is a polynonmil 
which annihilates G and whose degree is less than the degree k of the mini mu in 
polynomial of G Hence, we can divide by Ck and obtain (7 ’ as a polynomial in A 
Finally, substituting g{A) for G in the expression for G'\ we obtain G'^ = 
as a polynomial in A, as required It is important to note that the structure of the 
polynomial m A to which g~^{A) is equal depends upon A as well as upon g 
Hence, if f{A)/g{A) = h{A), we cannot conclude that for another matrix B wc 
necessarily have f{B)/g(B) = h{B) 

As we have seen, by successive applications of the Cayley- 
Hamilton theorem it is possible to reduce any polynomial in an 
(n,n) matrix to another polynomial in A whose degree is at most 
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a) 


(2) 


(3) 


(4) 


71 — 1. The use of the Cayley-HamiJton theorem is not always 
the most convenient way to accomplish this reduction, however, 
and, when the charactenstic values of A are all distinct, it is 
sometimes easier to proceed as follows’ 

Knowing that, for any polynomial p and any (n,n) matrix A, 
the matrix p{A) can be expressed as a polynomial, say </)(A), of 
degree at most n — 1, let us write 

0(X) = Ci[(X - \,){\ - Xa) • • (X - X„)] 

+ c,l(\ - Xi)(X - Xb) • (X - X„)] + • • 

-t c„[(X - X0(X - \,) • (X - X,_i)] 

where the 7th term on the right is the product of all the factors of 
the characteristic polynomial of A except X — X, Clearly, if 
Cl, C 2 , , c„ are arbitrary and the X^s are all distinct, the right- 

hand side is an arbitrary polynomial of degree 7i — 1. Then, 

p(A) = ci[(A - \,1)(A - X,/) (A - X„/)] 

+ C2[(A - \J){A - Xb/) (A - XJ)] + 

■f- c„[(A — Xi/)(A — X 2 /) (A — Xn-i/)] 

Now, if Xk is a characteristic vector of A corresponding to the 
characteristic value Xjt, it follows that 

V — Xjt/)A\ = 0 


Moreover, 


(A - \I)X, - [A - XJ + (X* - \)I]X, 

= (A — Xfc/)Xjfc + {Xk — Xj)A"i: 

= (X* — X})Xk 

Hence, if we postmultiply PAj (1) by A\ and simplify the products 
by successively applying Eqs. (2) and (3), we find that every 
product vanishes except the kth, and we have 

p(A)A, = CkliXk - Xi) (X. - X*_i)(X. - Xmi) ■ {Xk - XJlXfc 

Furthermore, according to Corollary 2, Theorem 5, Sec. 11.4, Xk 
IS a characteristic vector of the matrix p{A) corresponding to the 
characteristic value p{Xk) Therefore, 

[p(A) - p{Xk)I]Xk = 0 or p{A)Xk = p(X*)A, 


Thus, Eq (4) becomes 

p{Xk)Xk = Ck[{Xk — Xi) {Xk — Xk-\){Xk — Xfc+i) • {Xk — Xn)]Xk 


which implies that 

n 

p{Xk) = C* [] {Xk - x^) 

t-1 


p(W 

n 


n 

t"i 


or 


Ck = 
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(5) 


Therefore, substituting these values for the c’s into Eq. (1), we 
obtain the identity 


P(A) = 


n 



n - u) 


1-1 


This important result is known as Sylvester’s identity.* It mav 
be extended to cover the case in which the characteristic values 
of A are not all distinct, but we shall not undertake this extension f 


EXAMPLE 2 




-16 

-14 

-40 

If 

A - 

6 

7 

14 



6 

4 

14 


express p{A) - - 6.4® -f 12A* — 12^4* + 12^4* — 8A + 3/ in as simple a form as possible 

By a straightforward calculation we find, for the characteristic equation of A, 


lA - x:i 


-15 -X -14 -40 

6 7 - X 14 

5 4 14 - X 


= -X* + 6X> - IIX + 6 » 0 


Hence, the characteristic values of A are X| « 1, Xj - 2, Xa * 3 Therefore, 


p(Xi) - p(l) - 2 
p(X0 - p(2) - 3 
p(X,) - p(3) - 6 

and, substituting into Eq (5), 


p{A) - (A 


2J){A - 37) + - 


3 


(2 - 1)(2 - 3) 


(A - 7)(A - 30 


+ 


(3 • 


6 

1) (3 ' 


2 ) 


(A - /)(A - 21) 


A» - 2A + 3/ 


EXERCISES 

1 Without using the Cayley-Hamilton theorem, prove that every (n.n) matrix satisfies a 
polynomial equation of degree at most tj® 

2 Using the Cayley-Hamilton theorem, find the inverse of each of the following matncc's 


2 -4 -4 

b 

2 1 1 

c 

-4 -9 -3 

1 -4 -5 


1 4 3 


1 4 1 

-14 5 


-1-1 0 


3 3 2 


8 Find the minimum polynomial of eaeh of the following mat rues 


a 

1 1 1 


b 

-1 

2 

2 


1 1 1 



2 

-1 

-2 


1 1 1 



-2 

2 

3 

c 

1 1 

1 

d 

7 

2 

-2 


1 1 

-1 


-6 

-1 

2 


-1 1 

3 


6 

2 

-1 


* Named for the English algebraist J J Sylvester (1814-1897) 
t See, for instance, W J Duncan, H A Fraser, and A H Collar, “Ele¬ 
mentary Matrices," pp 78-79, Cambridge University Press, New York, 
1938. 
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4 Using both the Cayley-Haniilton theorem and Sylvester’s identity, evaluate 
p{A) - X* - /t< - -f -b ^ - 3/ 
for each of the following matrides A ‘ 


3 -2 



b 

4 -1 


c 

-2 

-6 

5 -4 




6 -1 



2 

5 

2 - 

4 

-4 

e 

-1 

1 

1 II 



1 - 

4 

-6 


2 - 

2 

-3 



-1 

4 

5 


-2 

2 

3 II 




6 \ij{x) “ x/{j 4- 4), express/(4 ) as a polynomial in A, for each of the following matrices A . 


a 

4 1 

b 

1 - I -2 

c p 4 e 


-3 0 


1 ^ ^ 

ii -3 -5| 


-4 

-9 

-3 

e 

2 1 

1 

1 

4 

1 


1 4 

3 

3 

3 

2 


-1 -1 

0 


11.6 

Infinite series of matrices 

III the last two sections we have considered polynomial and 
rational fractional functions of a sipiare matrix In this section 
we shall conclude our survey of the theory of matrices by inves¬ 
tigating briefly, and for the most part without proof, infinite 
series of matrices Once we have suitable criteria for the con¬ 
vergence of infinite series of matrices, it will then be possible to 
define and study transcendental functions of square matrices, 
such as sin A, and cos A, by allowing the corresponding scalar 
series to have matric arguments As oui experience with scalar 
series suggests, we must begin with the concept of the convergence 
of a sequence of matrices : 

DEFINITION 1 

If A 1 , A 2 , ,A„, is a sequence of (p,^) matrices, if (at;)n is the element in 

the ith row and jth column of A„, and if a„ is the corresponding element in a 
(p,g) matrix A, the sequence Ai, A 2 , , A„, is said to converge to the 

matrix A if and only if, for all values of i and lim {a^j)n = a^j 

n—»oe 

We indicate that a sequence of matrices {A„| converges to a 
matrix A by writing A„ A A sequence of matrices which does 
not converge is said to diverge or to be divergent. 

According to Definition 1, the convergence of a sequence of 
{p,q) matrices depends on the convergence of pq scalar sequences. 
Hence, it is only an easy application of familiar ideas to prove the 
following results 

lemma 1 

If tA„) and are two sequences of (p,q) matrices and if An —► A and Bn 
then, for all scalar constants a and /3, aA„ -}- ^Bn —► aA -|- fiB. 
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LEMMA 2 

If (A„) and [5nl are two sequences of suitably conformable matrices and if 
An—*A and —► By then AnBn AB. 

LEMMA 3 

If [yl„l 18 a sequence of (p,g) matrices and if An —> A, then, for suitably conform¬ 
able matrices R and *5, RA^^ —► RAS. 

PROOF From the definition of matric multiplication, the element in the ith 
row and jth column of the product RAnS is 

p fl 

J 2 r.k{aki).ai, 

Jb-1 I-l 

Since Tyk and sij are clearly independent of n and since, by hypothesis, (aki)n —> ajti, 
it follows that this finite sum converges to 

P Q 

2 ^ UkakiSii 

h~ii~i 

which is the element m the ith row and jth column of the product RASy as asserted 

Using the fact that any square matrix is similar to an upper 
triangular matrix, it is possible to prove the following imporiarit 
theorem,* 


THEOREM 1 

If A IS a square matrix, a necessary and sufficient condition that A” — ► 0 is tlial 
the absolute value of each characteristic root of A be less than 1 

We are now in a position to define the convergence of an 
infinite series of matrices: 

DEFINITION 2 

The series of matrices ^ CmA^ is said to converge to the sum S if and only if the 

m — 0 

sequence of partial sums 

I'Snl = { ^ c„Am| 

m — 0 

converges to S as n becomes infinite 

DEFINITION 3 

00 

A series of matrices ^ CmA„ is said to converge absolutely if and only if each 

m -0 

scalar senes ^ Cm((Uj)m is absolutely convergent. 

m *0 

As enterion for the absolute convergence of a series of nifl- 
trices, we have the result contained in the following theorem 


for instance, Mirsky, 'Tinear Algebra,” p. 328. 



SiC 11.4 


INFINITE SERIES OP MATtICES 


517 


theorem 2 

If dm IS the element of maximum absolute value in the matrix Am, then a necessary 

oo 

and sufficient condition that the series J* CmAm converge absolutely is that the 

m “0 

scalar series V |cm| |am| converge 

m — 0 

PROOF To prove the necessity of the condition of the theorem, let us assume 
that the given senes J CmAm is absolutely convergent Then, if ’S a (p,g) 

m -0 

matrix, it follows that, for all values of t and j such that 1 ^ ^ p and I ^ j ^ q, 

oa ao 

the series ^ Cm{avj)m ia absolutely convergent, that is, ^ |cm| ‘ |(at;)m| converges. 

m — 0 m — 0 

Let L 0) be the largest of the sums to which these pq series converge. Then, 
clearly, for all values of ^ and j and for every n > 0, 

S |c™l |(a.<)™| ^ L 

m — 0 

If we now sum the last inequality for all values of i and we obtain 

X X 

t,; m-O t,j 

From this, by reversing the order of summation on the left and noting that |cm| is 
independent of t c*nd we have 

(1) X X ^ 

m — O i,j 

Now the absolute value of the element of largest absolute value in Am surely can¬ 
not exceed the sum of the absolute values of all the elements in Am] that is, 

Ifflml ^ X 

t.J 

Hence, using this to underestimate the left member of (1), we have 
X km| |Om| g PqL 

m*0 

to 

Thus the series J |c„| • [o^nl converges, since its partial sums form a bounded 

m —0 

monotonically increasing sequence, and the necessity of the condition of the theo¬ 
rem is established. 

To prove the sufficiency of the condition of the theorem, let us suppose that 

m 

2 l^"»l ■ l®m| converges. Then, since l(a.,)ml ^ lum| for all i and j, it is clear that 
m -■ 0 

l^"»l l(ot^)m| ^ \cm\ \am\ foT all I and J. Hence, by an easy application of the com¬ 
parison test for the convergence of scalar series, it follows that ^ |cml ' l(a*j)»nl 

m — 0 

converges for all i and which proves that the given series of matrices converges 
absolutely, as asserted. 
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If a senes of matrices is absolutely convergent, it follows at 
once from the corresponding properties of scalar series that tho 
matric terms can be rearranged at pleasure without in any wav 
affecting the sum of the series 

With the exception of Theorem 1, all the observations wc 
have so far made about sequences and series of matrices apply to 
matrices of any shape However in most applications we are con¬ 
cerned only with senes of square matrices and, in particular, wiili 
power senes of such matrices The fundamental tlieorem on 
matrii* power senes is the following * 


THEOREM 3 

If the absolute value of each characteristic root of a square matrix A is less tlian 

ao 

the radius of convergence of the scalar power senes <p(z) = J CmZ*^, then (he 

m =» 0 

matnc power series ^ CmA”^ converges If the absolute value of at Icust 

m “ 0 

one characteristic root of A is greater than the radius of convergence of 
then <i>(A) diverges In particular cases, if the absolute value of tho charactensin 
root of largest absolute value is equal to the radius of convergence of (f){z), tla 
matric senes <t>{A) may either converge or diverge 

COROLLARY 1 

If 4>{z) converges for all values of 2 , then 4>{A) converges for all square matnc('s A 


COROLLARY 2 


If 0(A) - ^ CmA^ converges and if A is similar to a diagonal matrix, that is, if 

m — 0 


then 


S-'AS = D = 


X O 

A2 

O X. 


HA) = 


0(^1) 

0(^2) 

0 

0 



PROOF Clearly, the partial sums of the series 0(A) are all polynomials in A 
Hence, by Theorem 6, Sec 114, 


N 

01V (Xi) 

0 

4>n(A) = J c^A" = S 

m- 1 

0JV(X2) 

0 

0jv(x„) 


* See, for instance, Mirsky, “Linear Algebra,“ p. 332. 
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Now, by hypothesis, 4^(A) converges. Hence, each of the scalar series 0 (X,) must 
converge; that is, for each 07 ^(Xi) —> 0(X,). Therefore, as —► », 


^w(Xi) 

4>n0^2) 


0 (x.) O 

*(X,) ^ 

C3 0w(X„) 


O 4>{K) 


and we have, by Lemma 3, 

<t>{A) = S 


0(Xi) 

o 

</>(X2) 

o 



as asserted. 


The last result provides us with a useful method of evaluating 
the sum of certain matric power senes, which is sometimes 
preferable to the use of the Cayley-Hamilton theorem or Syl¬ 
vester’s identity 

EXAMPLE 1 

0 -2 
1 3 

The given matrix A is the one we considered in Example 3, Sec 11 4 Hence from that 
(\amplc we know that the characteristic equation of A is X* — 3X + 2 “ 0 and that Xi ■* 1, 
Xj = 2, and 


What iM if A 


S-^AS 

'Pherefore, by the last corollary, 
A q II 


1 0 

2 1 



1 j 

0 2 

where 5 = ^ ^ 

and 

iS-' - 

-1 -2 


0 

0( Xj) 


2 1 
-1 -1 

2c ~ e' 
—e -b 


c 0 

1 

1 

1 0 c* 

-1 

-2 


2c - 2e* 
-c -b 2c* 


To evaluate by means of the Cayley-IIaimlton theorem, we must simplify each of the 
powers of A in the expansion of e^, using the rclat'on .4* — 3A + 2/ * 0, or 

yl * = 3.4 - 2/ 

At first glance this would seem to be a very tedioii.s process, since arbitrarily high powers of A are 
involved However, we may shorten the work appreciably by proceeding inductively From the 
fact that the characteristic equation of >4 is quadratic, we know that any positive integral power 
of A can be expressed as a linear binomial in A Hence, if we assume 


we have 


/I" “ OnA A- bnT n 
A"'*'* - an^\A -b fcn+l/ 


2, 3, 4, 

A A ** = a„A * -b bnA 


Therefore the o's and fe’s satisfy the recurrence relations* 

On + l " 3fln "b bn and “ 2fln 


. tt«(3A - 27) -b bnA 
“ (SOn -b hn)A — 2 anl 


These are examples of what are known as difference equations, see Sec 4.5 
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with, of course, the initial conditions ai =■ 3, 6a ■■ —2. From these it is easy to verify that 

fla " 3 6 i " —2 

Cl “ 7 63 " —6 

at - IS 64 - —14 

as » 31 hs — —30 


Hence, 


On - 2" - 1 


6„ - -2" -h 2 


, , , , (2= - IM + (-2> + 2)1 , (2> - 1)A + (-2> + 2)1 , 
I + A + --1- .r, -1- 




-h 

I 

A 


21 

22 _ 1 2=>-l 

"IT"' 


)^i 


3’ 

2-2= 2 - 2® 

1 +-^-+-17- + 


K 2 2 = 2 =* \ / 111 \ 

K ill \ / 2 2 = 2 =* 


+ / 

= - 2) - /(e2 - 2c) 



0 -2 


1 0 

- (c= - e) 

1 3 

- (6* - 2e) 

0 1 


2f — e* 2c — 2c- li 

— c + t'= — c -f 2c= II 

as before Finally, usmp; Sylvester's formula, we have 
0 (^ 1 ) 


0( t) 


\i — 


0( ^ 2 ) 

{A - \,1) + {A -\J) 

Xa — Xi 


21) -f Y (/I - I) 


= ,4(e= - r) - /(c= - 2c) 

which 18 the first expression we obtained using the Cayley-TIamilton theorem 

The question of whether or not scalar identities such 
e^ey ~ sin 2 j = 2 sin x cos x, and 

cos (x + y) — cos X cos y — sin x sin y 

remain valid when x and y arc replaced by square matrices 
obviously an important one. We cannot investigate the maltei 
here, but the applications one is likely to encounter are covered 
by the following theorem * 


THEOREM 4 

For the elementary transcendental functions, scalar identities in a single variable 
remain valid when the scalar variable is replaced by a square matrix Scalar 
identities in two variables remain valid when the scalar variables are replaced by 
square matrices only when the two matrices commute. 


* See, for example, Mirsky, "Linear Algebra," pp. 338-341 
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1 Prove Lemma 1 
S Prove Lemma 2. 

8 For the matrix A of Example 1, compute and verify that e^e~^ — I 
4 Using Sylvester’s identity, compute cos A, and sin A for each of the following matrices A : 


2 1 

1 4 

-1 -1 


-1 1 1 
2 -2 -3 

-2 2 3 


6 Using both the Cayley-Hamilton theorem and Sylvester’s identity, evaluate for 

X - I ‘ • 

I -1 0 

6 For each of the following matrices A, verify that sin 2^4-2 sm A cos A . 

a I 3 21 b I 2 1 

I -3 -21 I -3 -2 

c 1 1 1 d -1 2 2 

111 2 - 1-2 
111 -223 


, verify that none of the following relations holds 


2 1 

and B »= 

1 0| 

-2 -1 

1 1 

-2 -ir 


•1 (.1 ± W) == sin A cos B ± cos A sin B 
coH (A ± B) “ cos A cos B T oin A sin B 


, verify that each of the following relations 


sm (/I ± B) Bin A cos B ± cos A sin B 

cos (A ± B) ^ cos .4 cos B T sm A sin B 

9 Del ermine for what values of x and y, if any, the iiiatrues 

.4=1! ^ ' 11 and fl = |i ^ ' 

II -a- 1 - X II || -1 - y 

coinniutc, and verily that, under these (onditions, 

hin (.4 ± fi) — sin A cos B ± cos A sin B 

cos (/I ± /J) = cos A roH B + sin A sm Ji 

I 1 0 2 j ^ 

10 If .4 « I 0 —1 —2 I, show tliat sin yl “ yl-Obtaji 

12 -2 o! 

COS A, and verify that cos* A + sm* A ^ I 


CHAPTER TWELVE 


Vector Analysis 


12.1 

The algebra of vectors 

In Sec 10 2, in our discussion of determinants and matrices, a\c 
introduced the concept of a vector as an ordered set of n quantities, 
say (ai,a 2 , ,a„) In the present chapter we shall undertake 

the study of what is known as vector analysis, usinf^ the inort^ 
traditional (and limited) definition of a vector as a quantity, such 
as force, velocity, or acceleration, which possesses both magnitude 
and direction Although this approach has been all but abandoned 
in pure mathematics because it is unnecessarily restricted, it is still 
the usual approach m physics and in engineering, and the resull.s 
to which it leads are of great utility in these fields 

Almost any physical discussion will involve, in addition to 
vector quantities, other quantities, such as volume, mass, and 
work, which possess only magnitude and aie known as scalars. To 
distinguish vectors from scalars we shall consistently write the 
former in boldface type, thus, V This is a rather common nota¬ 
tion, although some authors indicate that a symbol stands for a 

vector quantity by putting an arrow above the symbol, thus, V 
A scalar quantity can be adequately represented by a mark 
on a fixed scale To represent a vector quantity, however, we must 
use a directed line segment whose direction is the same as the 
direction of the vector and whose length is equal (on some con¬ 
venient scale) to the magnitude of the vector. For convenience, 
we shall often refer to the representative line segment as though it 
were the vector itself. The magnitude or length of a vector A is 
called the absolute value of the vector and is indicated either by 
enclosing the symbol for the vector between ordinary absolute- 
value bars or simply by setting the symbol for the vector in 
ordinary rather than boldface type Thus, 

A = 1A| 
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represents the magnitude, or absolute value, of the vector A. 
Regardless of its direction, a vector whose length, or absolute 
value, is unity is called a unit vector. A vector is said to be zero 
if and only if its absolute value is zero The direction of a zero 
vector is undefined. 

Two vectors whose magnitudes, or lengths, are equal and 
whose directions are the same are said to be equal, regardless of 
the points m space from which they may be drawn * If two vec ¬ 
tors have the same length but are oppositely directed, either is 
said to be the negative of the other. 

The sum of two vectors A and B la defined by the familiar 
parallelogram law, i.e , if A and B are diawn from the same point, 
or origin, and if the parallelogram having A and B as adjacent 
sides IS constructed, then the sum A + B is the vector represented 
by the diagonal of this parallelogram which passes through the 
common origin of A and B (Fig 1*2 la) From this definition it is 
evident that 




A + B = B -h A 

1 e , that vector addition is commutative, and that 
A + (B + C) = (A -h B) -h C 

1 e , that vector addition is associative By the difference of two 
vectors A and B, we mean the sum of the first and the negative of 
the second, i e , 

A - B = A -h (-B) 

(Fig 12 16) By the product of a scalar a and a vector A we mean 
the vector aA whose length is equal to the product of \a\ and the 


• In other words, a vector quantity can be represented equally well bv any 
of infinitely many equivalent line segments, all having the same length and 
the same direction it is, therefore, customary to say that a vector can be 
moved parallel to itself without change In some applicatioriH, however, as 
for instance in dealing with forces whose points of application or lines of 
action cannot be shifted, it is necessary to think of a vector as fixed, or at 
least limited in position Such vectors are usually said to be bound, in con¬ 
trast to unreatneted vectors, which are said to be free. 
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magnitude of A and whose direction is the same as the direction 
of A if a is positive and opposite to it if a is negative. 

In addition to the product of a scalar and a vector, two other 
types of product are defined in vector analysis. The first of these 
is the scalar or dot or inner product, indicated by placing a dot 
between the two factors. By definition, this is a scalar equal to 
the product of the absolute values of the two vector factors and 
the cosine of the angle between their positive directions; i.e , 

(1) A • B «« |A| |B| cos B = AB cos $ 

Since |A| cos 0 is just the projection of the vector A in the direction 
of B and since |B| cos B is the projection of the vector B in the 
direction of A, it follows that the dot product of two vectors is equal 
to the length of either of them multiplied by the projection of the other 
upon it (Fig. 12.2). Two particular cases of this are worthy of 


FIGURE 12.2 
The geometrical 
interpretation of 
the scalar 
product 



note' If one of the vectors, say A, is of unit length, then A • B 
becomes simply 


( 2 ) 


|B| COB B = B cos B 

which is just the projection, or component, of B in the direction of 
the unit vector A. On the other hand, if A = B, then, obviously, 
cos B = cos 0 = 1, and we have 

A-A = |A|*»A’ 


From the relation between dot products and projections it is 
easy to show that dot multiplicaiion is distributive over addition, i.e , 

(3) A . (B -f C) = A • B H- A • C 


Moreover, from the definitive relation (1) it is clear that dot 
multiplication is commutative, i.e.. 


(4) A • B = B . A 


However, if the dot product of two vectors is zero, it does not 
follow that one or the other of the factors is zero, for there is a 
third possibility, namely, cos 0 = 0. Thus i/ A • B = 0, then either 
at least one of the vectors (A,B) is zero or A and B are perpendicular 
The third type of product with which we shall deal is the 
vector, or cross product, indicated by placing a cross between the 
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factors.* If A and B are the factors, then by definition A x B is a 
vector V whose absolute value is the product of the absolute values 
of A, B, and the sine of the angle between them, and whose direc¬ 
tion is perpendicular to the plane determined by A and B and so 
sensed that a nght-handed screw turned from A toward B through 
the smaller of the angles between these vectors would advance in 
the direction of V (Fig. 12.3o). Since IB| |sin $\ is the projection 
of B in a direction perpendicular to A, or, in other words, is the 
altitude of the parallelogram determined when A and B are drawn 
from a common point, it follows that the magnitude of A X B, 
namely, |A| (|B| |sin ^j), is equal to the area of this parallelogram 
(Fig 12.3fc) 


Ax B 



From the relation between cross products and areas it is easy 
to show that cross mulhpltcation is distribuiwe ot^er additiov, i.e., 

(5) A X (B -h C) = A X B -h A X C 

However, since the direction of A X B is determined by the right- 
hand rule, it IS clear that interchanging A and B reverses the direc¬ 
tion, or sign, of their product Hence, cross multiplication is not 
commutative, and we have, in fact, 

( 6 ) A X B = -B X A 

Multiplicat ion in which product s obey this rule is sometimes said 
to be onticommutative. 

From the foregoing it is clear that we must be careful to 
preserve the proper order of factors in any expression involving 
vector multiplication Moreover, if A X B = 0, we cannot con¬ 
clude that either A or B is zero, for this product will also vanish 
if sin 0 = 0 Hence i/ A x B = 0, then either at least one of the 
vectors (A,B) is zero or A and B are parallel. 

It is often convenient to be able to refer vector expressions to 


* Meaning has also been given to the syrobol AB, and in fact under the name 
^ad such combinations nave been extensively studied, as, for instance, m 
Gibbs-Wilson, "Vector Analysis.” Yale University Press, New Haven. Conn., 
1929 We shall not consider them in our work, however, smee they are 
actually special cases of what are known as tensors, which we shall consider 
from a somewhat different point of view in the next chapter For us, the only 
possible product-type combinations of two vectors will be the dot and cross 
products themselves 
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a cartesian frame of reference To provide for this we define i, j, 
and k to be vectors of unit length directed, respectively, along the 
positive j-, 2/-, and a-axes of a right-handed coordinate system. 
Then ad, yj, and zk represent vectors of lengths x, y, and z whose 
directions are those of the respective axes, and from the definition 
of vector addition it is evident that the vector joining the origin 
to a general point P \{x,y,z) (Fig. 12.4) can be written 


FIGURE 12.4 

The representa¬ 
tion of a vector 
as a Imear com¬ 
bination of the 
unit vectors 

i, I. k 



(7) R = ri + ?/j -h 2k 

In more general terms, any vector whose components along ihe 
axes are, respectively, ai, a2, and can be written 

A = ad -b a2j -h agk 
If, further, 

B = 6ii “h 6^ "1“ b^k 

then A ± B = (ai ± bi)i + (02 ± 62)! + (03 ± & 3 )k 

Clearly, two vectors will be equal if and only if their respective com¬ 
ponents are equal Hence, any vector equation implies three scalar 
equations. 

Since the dot product of perpendicular vectors is zero, it 
follows that 

(8) i • j = j . k = k . i = 0 

Moreover, applying (2) to the unit vectors i, j, k, we have 
(8) i • i = j • j = k • k = 1 

Hence, if we write 

A • B = (ad "h ad ~ 1 - aak) ■ (6d "b b^ 63k) 

and use the fact that dot multiplication is distributive over 
addition [Eq. (3)] to expand and simplify, we obtain the important 
result 


( 10 ) A ■ B K fli^i 4 “ 0362 4“ a^bi 
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(11) 


( 12 ) 


(13) 


(14) 


(15) 


In particular, taking B = A, we have 
A • A = jA|^ = ai* “I" flj* -j- 


or 

|A1 = Vai' + + a,«t 

On the other hand, if we write A • B = |A| |B| COS 6 and then solve 
for cos 6, using (10) and (11), we obtain the useful formula 

« _ + (libi -j- 

vjOn U —-- ,— — — 

Vai’' + <i2* + a,* v/fei' + W + 

a result familiar from analytic gemoetrv. where the a's and b's were 
introduced not as the components of two vectors, but as the 
direction numbers of two straight lines. 

For the cross products of the unit vectors i, j, k we find at 

once 


ixi = jxj-kxk = 0 
i X j = -j X i = k 
j X k = -k X j = i 
k X i = -i X k = j 

Hence, using (13) and the fact that cross multiplication is dis¬ 
tributive over addition, we obtain for 

A X B = (ad -h a^i -h a^k) X (fed -f- fe2j “h fe»k) 
the expression 

A X B = (aafea — aafe2)i — (^ifea — aafei)j + (oife2 — UafeOk 


which IS precisely the expanded form of the determinant 


A X B 


i j k 

(l\ 0,2 dz 


I fei fe2 fea I 

The anticommutative character of vector multiplH'ation thus cor¬ 
responds to the fact tha^ interchanging two rows of a determinant 
changes the sign of the determinant. 


EXAMPLE 1 

Using vector methods, derive the law of cosines 

To do this, let directions be assigned to the sides of the given triangle as in Fig 12 5 
Then C ■■ A — B, hence, 

CC-(A-B)(A-B)-A A-2AB-|-BB 
or, using (1) and (2), 

C* - - 2AB cos e 

which IB the law of cosines 


t Formula (10) is precisely the scalar product of the two vectors A - 
||ai,aj,a8|| and B ” f|bi,6a,6i|| as we defined it from the more general point of 
view of Chap 10 (Sec. 10 2) Similarly, Formula (11) gives the length of the 
vector A — ||oi,as,oi|| as we defined it m Chap 10, Sec 10 2. 
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The triangle uaed 
m the vector 
derivation of the 
law of cosines 



EXAMPLE 2 

If (x,y,z) and (x',y\z') are two right-handed coordinate systems having a common ongin, obtain 
by vector methods the transformation equations connecting the two systems of coordinates 
To do this, let i, j, k and i', j', k' be unit vectors m the direction of the respective axes 
(Fig. 12 6), and let F be a general point in space having coordinates (x,y,z) and (x',y',z') m the 
respiective systems Now, the coordinates {x',y\z') are simply the components of the vector OP 
along the x'-, y'-, z'-axes Hence, if we write 

R - OF - XI + i/j -b zk 

and observe that the dot products of this vector with the unit vectors i', j', and k' are its com¬ 
ponents m these directions, we find the required formulas to be 

x'-R-i' - (xi + i/j-b zk) • i' -x(i-r) +y(j-i') + z(k • 1') 

- R . j' - (xi + yj -b zk) • j' = x(i • j') -b v(j • j') + 2 (k ■ j') 

z' - R • k' - (ji -b yj -b zk) • k' « x(i • k') -f i/(j • k') -b z(k • k') 

From (1), the products (i • i'), (j • 1'), , (k * k') are just the cosines of the angles between 

the various axes of the two systems and are known from the data of the problem 

When we consider products involving three rather than two 
vectors, we encounter the following possibilities' 

(A • B)C A • (B X C) A X (B X C) 

The first can be dismissed with a word In fact A • B is just a scalar, 
and thus (A • B)C is simply a vector whose length is |A • B| times 
the length of C and whose direction is the same as that of C or 
opposite to it, according as A • B is positive or negative. 

For the product A • (B X C), which is known as a scalar 
triple producti we observe first that the parentheses enclosing the 
vector product B X C are superfluous There is, in fact, only one 
alternative interpretation, namely, (A ■ B) x C, and this is 
meaningless, since both factors in a cross product must be vectors 


FIGURE 12.6 
Two rectangular 
coordinate 
tems with the 
same origin. 


F’ ,! t (x'.y'pZ') 
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(a) (6) 


FIGURE 12J 

The geometrical interpretation of the scalar triple product 

whereas A • B is a scalar Thus, no meaning but the intended one 
can be attached to the expression A • B X C, hence, it is customary 
to omit the parentheses 

Geometrically, the scalar triple product A • B X C represents 
the volume of the parallelepiped having the vectors A, B, and C as 
concurrent edges h'or, it we regard the parallelogram having B and 
C as adjacent sides as the base of t his figure, then B x C is a vector 
whose direction is perpendicular to the base and whose magnitude 
18 equal to the area of the base Moreover, the altitude of the 
parallelepiped is the projection of A on B x C (Fig r27a) Hence, 
A • B X C, whose value is just the magnilude of B x C multiplied 
by the projection of A on B x C, is ninnerically equal to the 
volume of the parallelepiped If 6 is less than 7r/2, i e., if A and 
B x C lie on the same side of the plane of B and C, then cos S is 
positive and so is the scalar triple product In jiarticular, chBi'gmg 
the order of the factors B and C gives the product C X B, whose 
direction, of course, is ojijiosite to that of B X C; hence 

(l(j) ABxC = -ACxB 

Since the volume of a paralh'lepiped is independent of the face 
chosen as its base, il follows, by applying the preceding argument 
to Fig 12 7 h and c, that B • C x A and C ■ A X B also give the 
volume oi Ili(‘ same parallelepiju'd From this faet, together with 
(!()), we tlieiefore find 

A B xC = B CxA = C AxB 

(17) -A CxB - -B AxC = -C BxA 

The first thiee ai rangeinents ran be obtained by st art iiig anywhere 
on the circle in Fig 12 8 and reading the lotteis in the counler- 
clockwise direction. For this reason they are said to be cyclic 
permutations of one another Similarly, the last three arrange¬ 
ments are cyclic permutations of one another which can be 
obtained by reading the letters in Fig 12 8 in the clockwise direc¬ 
tion. Thus, (17) as.serts that aiiy cyclic permutation of the factors 
in a scalar triple product leaves the value of the product unchanged, 
whereas a permutation which reverses the original cyclic order changes 
the sign of the product. 
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An lUuBtration 
of cyclic and 
anticyclic permu 
tations 

Furthermore, since the order of factors in a dot product is 
immaterial, we find, by considering the first and third members 
of (17), that A*BxC = C*AxB = AxB'C, which shows 
that in any scalar triple product the dot and cross can be intei- 
changed without altering the value of the product For tins reason 
it is customary to omit these symbols and write a scalar tuple 
product simply as [ABC] 

If the vectors A, B, C all he in the same plane or aie paiallcl 
to the same plane, they necessarily foim a parallelepiped ot zcio 
volume, and conversely Hence, [ABC] - 0 is a iiecessap\ and 
sufficient condition that three veclors A, B, and C be jiaralhl lo 
one and the same plane In particular, if two factois of a scalar 
triple product have the same direction, the jiroduct is zero 

Analytically, if we write 

A = dii “f" 02) "b flak B = hii -)- b^j H- b^k C = Cii coj cjk 

we have 

A • B X C = (aii -|- 02] -f a^k) • [(62C3 - b^c^)! - (biCs - b^Ci)] + (biCn - b^rM 

« ai(f^2C3 - haCi) — a2(hic., — h^Ci) -f a^{b^C2 — b-iC^) 

w'hich is just the expanded form of the determinant 
(Xi rt2 Uj I 

(18) [ABC] = bi 62 bi 

Cl C2 C3 

The relations in (17) are thus equivalent to the familiar fact that 
interchanging any twm rows in a determinant changes the sign of 
the determinant 

EXAMPLE 3 

If A, B, and C are tlircp vertorH \\hich are not parallel to the aame plane, show that aiiv 
vector V can be expressed as a linear combination of A, B, and C 
If we write 

(19) V oA -f- bB -P cC 

where a, 6, and c are scalar constants to be determined, and form the cross product of each 
member with the vector B, we obtain 

VXB«aAXB-f-bBXB+cCXB»oAXB-PcCXB 

where the term B X B vanishes because its factors are identical. Now, if we form the dot 
product of the last result and the vector C, we have 



VxBC-oAXBC+cCXBC-oAXBC 
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M here the term C X B ■ C vaniahes because it is a scalar triple product with two factors 
identical By hypothesis, A, B, and C are not parallel to the same plane Hence, A X B * C is 
difterent from zero, and we can solve for a, getting 

[VBC] 

“ ” [ABC] 

In tl»n snme way we ran obtain the remaining constants in the lequireit linear <-omhina1ion 

h = = [ABVl 

[ABC] ^ “ [ABCl 

I'hufl, under the conditions of the problem, 


( 20 ) 


V 


|VBC ] (Avq |ABV] 
[ABC] ^ [ABC] ^ [ABC] 


The following spt'cial chhc of this result is often useful If V ih nny vectoi parallel to the 
plane determined by A and B, then [ABVl = 0 and the last teim in the expansion (20) la zero 
lienee it follows that, if A and B are vectois which aie not pouillel to the same line and if V is 

CMV vector parallel to the plane di'ti'rrnined b> A and B, then V ean he expn*Hsed as a linear 

combination of A and B 

To express the vector triple product A x (B x C) in a simpler 
expanded form, let us eonsidei first the general ease in whieh 
neither A, B, nor C is a zero vector and B and C are not parallel 
Now, from the delinilion of a cross product it is clear that 
A X (B X C) IS a vector perpcndiculai to A and to B X C. But 
B X C IS itself perpendicular to the plane of B and C, and, thus, 
any vector such as A X (B x C) winch is perpendicular to B X C 

must lie in the plane of B and C (Fig 12 D) Hence, by Kxarnple 

d, the vector A X (B X C) must bo expressible as a linear combina¬ 
tion of B and C, that is, 

A X (B X C) - \B -h mC 

To find X and p, vve hrsi use the fact that A X (B X C) is also 
perpendicular to A and, herue, that its dot product with A must 
be zcio 

A • [A X (B X C)1 - A • (XB -h /iC) - X(A • B) + /i(A • C) =0 
Thus, 

X A-C 
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and, therefore, 

X=KA-C) - HA-B) 

and 

(21) A X (B X C) = 1/ [(A . C)B - (A - B)C1 

To find V, it is convenient to consider first the special case in 
which A = B. 

(22) B X (B X C) = .ifCB • C)B - (B •B)C] 

Let 6 be the angle between B and C, and form the dot product of 
C with each side of the last equality Then, using the properties of 
the scalar triple product and applying Formulas (1) and (2) to the 
resulting dot products, we have 

B X (B X C) - C = -(B X C) . (B xC) = .i[(B.C)(B-C) - (B-B)(C -C)] 
-IB X C|2 = cos* e - J?*C*) 

sin* d = *;iB*C*(cos* ^ - 1) = sin* B 

lienee, = 1, and (22) becomes specificially 

( 23 ) B X (B X C) = (B - C)B - (B • B)C 

We now return to Eq (21) and form the dot product of both 
members with B 

A X (B X C) • B = r[(A • C)(B . B) - (A . B)(C . B)] 

Now, by an obvious rearraiigement of the scalar triple pioduct on 
the left, we have 

-A • B X (B X C) = .[(A • C)(B * B) - (A • B)(C • B)] 
or, applying Eq (23) to the left-hand side, 

-A • [(B • C)B - (B • B)C] = v[{k . C)(B • B) - (A • B)(C • B)1 

which will be true if and only if v = 1 t Hence, m general, 

( 24 ) A X (B X C) = (A . C)B - (A • B)C 

Moreover, if either A, B, or C is zero or if B and C have the saiiu' 
direction, it is evident by inspection that Eq (24) still holds 
Hence, the restrictions we imposed upon A, B, and C at the 
beginning of our discussion can be eliminated, and Eq. (24) is 
correct in all cases 

By a straightforward application of Eq (24) we find that 

(A X B) X C --C X (A X B) = - (C • B)A -h (C . A)B 

which IS not equal to A X (B x C) Hence, the position of the 
parentheses in a vector triple product is significant 

With a knowledge of scalar and vector triple products, 
products involving more than three vectors can be expanded with- 


t Unleas, of course, (A • C)(B • B) — (A • B)(C • B) — 0, m which case the 
value of V IS irrelevant. 
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out difficulty For instance, 

(A X B) • (C X D) 

can be regarded as the scalar triple product of the vectors A, B, 
and (C X D) This allows us to write 

A X B • (C X D) = A • [B X (C X D)] 

= A . [(B • D)C - (B • C)D] 

= (A*C)(B-D) - (A-D)(B-C) 

This result is sometimes referred to as Lagrange’s identity. 

Similarly, (A X B) X (C X D) can be 1 bought of as the vector 
triple product of (A x B), C, and D or of A, B, and (C x D). 
Taking the former point of view and applying (24), we find 

(A X B) X (C X D) = [A X B . D]C - (A X B • C]D 
= [ABD]C - [ABC]D 

which IS a vector in the plane of C and D From the latter point of 
view, 

(A X B) X (C X D) = -(C X D) X (A X B) 

- -[C xD B]A + [C xD A]B 
= [CDAIB - [CDB]A 

which IS a vector in the plane of A and B These two results 
together show that (A X B) X (C X D) is directed along the line 
of intersection of the plane of A and B and the plane of C and D 

EXERCISES 

1 For each of the following sets of vectors 

a A - 2i - 2j -f k b A = 2i - 3j + 6k c A » lOi + lOj -h r>k 

B - i -|_ Sj - 4k B “ lOi -h 2j + 1 Ik B - 5i - 2j - 14k 

C - 12i - 4j - 3k C = 2i - 9j - 6k C - 4i -f- 7j - 4k 

what are the lengths of A, B, and C’ What is A • B? A X the projection of B on the 
projection of C on B'^ the angle between A and B? [ABC]"^ A X (B X C)? the volume of the 
parallelepiped having A + C, A — C, and B as concurrent edges’'’the volume of the parallele¬ 
piped having A -b C, A — C, and C as concurrent edges'^ 

2 If A, B, and C are any three vectors, prove that 

A X (B X C) -b B X (C X A1 + C X (A X B) - 0 

8 Prove that (A X B) ■ (C X D) + (B X C) ■ (A X D) -b (C X A) ■ (B X D) - 0. 

4 If the plane determined by A and B is perpendicular to the plane determined by C and D, 
show that (A X B) • (C X D) “ 0 

5 Show that the volume of the tetrahedron having A -b B, B -b C, and C -b A as concurrent 
edges IS twice the volume of the tetrahedron having A, B, and C as concurrent edges 

6 If A 18 a given vector and X ■ A “ Y ■ A, can we conclude that X « Y? 

7 Are two vectors equal if they have equal components m a given direction? in two given 
directions? m three given directions? in an arbitrary direction? 

8 Find the unit vector perpendicular to both i — 2j -b k and 3i -b j — 2k. 

9 Find the unit vector parallel to the plane of I + j — 2k and 3i — 2j -b k and perpendicular 
to 2i -f 2j - k. 
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10 

11 

12 

18 

14 

16 


16 

17 

18 


10 


20 

21 

22 

23 


Show that, if the four vectors A, B, C, D are coplanar, then fAXB) X(C XD) *0 Is 
the converse true^ 

Show that, if A -h B + C = 0, then AXB=BXC”CXA Is the converse true? 
Prove that two nonzero vectors are linearly dc^iendent if and only if they are parallel 
Prove that three vectors are linearly dependent if and only if they are paiallel to the haine 
plane 

Prove that four vectors are always linearly dependent (TTint Expand (A X B) X (C X D) 
in two different ways and equate the results ] 

Prove that, for all values of the a’s and b'e, 

(a,hi + a,b, 4- a,b,r ^ («.’ + a** 4 4 b,^ 4 


This 18 the special case n = 3 of what is known as Cauchy’s inequality, 

1-1 1=1 .=1 

By considerinp; the dot product of the two vectors A = ap 4 flsj and B «” /;ii 4 bi], 
derive the formula foi the cosine of the difference of two anj^les. 

By eonsidcrmp; the cross product of the two vectors of Exercise 16, derive the formula for 
the sine of the difference of two angles 

Show that, if A ”■ ap f 4 «ik is a constant vector drawn from the origin, the locus of 
the end points of the vectors R = ri 4 vj + which satisfy the equation (R — A) A = 0 

15 a plaiK' perpendicular to A at its end point What is the locus of the (‘iid points of tlu 
vectors which satisfy the equation (R — A) R = 0^ (R — A) (R — A) = 0? 

The three noncollinear points L, M, and N he in the plane p Prove that, if L, M, and N are 
the vectors to tliese points from an origin not lying m p, the vector 

(L X M) f fM X N) 4 (N X L) 

16 perpendicular to p 

Carry Ihrough in detail the gcornetncal proof that dot multiplication is distributivi* over 
addition 

Carry througli in detail the geometrical proof that itobs multiplication is distributive ovci 
addition 

Prove that (A X B) ■ (B X C) X (C X A) » [ABC]* 

If A, B, and C are any thiec independent vectors, the vectors 


U 


B V = ^ * w = * ® 

[ABC| |ABC| [ABC] 

are said to form a set reciprocal to the set A, B, C Show that 

A-U = B- V = C- W-1 and that [UVWl 


1/lABC] 


If A = 1 4 3j — 2k, B =“ 1 4 8j 4 4k, and C =» 121 - 4j 4 3k, express the vector 
1 b 2j 4 3k as a linear combination of A, B, and C and as a linear combination of the 
vectors U, V, and W of the set reciprocal to A, B, and C 
24 Show that, if A = a,i f azj 4 a»k, B = 6ii 4 b 2 ] 4 l>ik, C = cp 4 4 cak, and 

D ■■ dii 4 d‘i\ 4 dak, then the system of equations 

aix 4 biy 4 Ciz » di 
ajj 4 biy 4 c,z =■ dz 

aji 4 bay 4 Cjz — dj 

is equivalent to the single vector equation xA -j~ yB -f- zC ^ D. Assuming that [ABC] d, 
solve this vector equation for x, y, and z, and show that the result is equivalent to that 
obtained from the algebraie form of the system by using Cramer’s rule (Theorem 7, Sec 
10.3). 
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26 In mechanics the moment Af of a force F about a point 0 is defined as the magnitude of P 
times the perpendicular distance from the point O to the line of action of F If the vector 
moment M is defined as the vector whose magnitude is M and whose direction is perpen¬ 
dicular to the plane of O and F, show that M = R X F, where R is the vector from 0 to any 
point on the line of action of F Would M = F X R be equally acceptable^ Explain 


12.2 

Vector functions of one variable 


(I) 


( 2 ) 


(3) 

(4) 


(r)) 


If / IS a scalar variable and if to each value of t in some range there 
corresponds a value of a vector V, we say tliat V is a vector function 
of t Since the component of a vectoi in any direction n. known 
whenever the vector itsrlf js fnown, it follows that, if V is a 
function of t, so, too, aie its (“omjionents in the dinytions of the 
unit vectors i, j and k Henco, wv can write 

V(0 = V,(0i 4- V,(f)i + T4(0k 

In particular, we say that V(0 is continuous if and only if the 
three scalar functions Vi(t), yM are continuous 

If the independent variable / of a vector function V(0 changes 
by an amount Af, the function will in general change Vioth in 
magnitude and in direction In other uords, corresponding to the 
scalai increment Af we have the vectoi increineiii 

AV = V(f + Af) - V(f) 

= fl i(f “h Af)i -f" I 2(f “I" ^ ^(f 4“ Af)k1 

- [14(0i 4- r,(0j -4 VAm 

= A1 )1 -f- Al^2j “h AVtk 

By lliederivativeof a vector function V(f), we mean, as usual, 

dV . V(f + Af) - V(f) . AV 

— = liin - —- = luu 


or, using (2), 

dV , ATi. . AV4. , ._Ar, 

= hill “ 1 + Inn —- j 4- hm -- k 

dt Af Af M~^{) Af 

dt ^ dt ^ (it 


From (3) we are motivated to dehne the differential of a vector 

function V(f) to be 

dV = dV.i + dV2i + dV^k 

In particular, for the very important vector 

R = xi 4- ?/j + 2k 

drawn from the origin to the point (x,y,z), we have 
dR dx i dy i + dzk 


( 6 ) 



VECTOR ANALYSIS 


CHAR 12 


From the definition of the derivative of a vector function of 
one variable it follows that sums, differences, and products of 
vectors can be differentiated by formulas just like those of ordinary 
calculus, provided that the proper order of factors is maintained 
wherever the order is significant. Specifically, we have 


(7) 

d(U + V) 


dl 

dt “ dt 

(8) 

dl 

II 

< 

(9) 

d(U • V) 

dl 


(10) 

d(U X V) 

dt 


(11) 

d[UVWl 

dl 

-[fvw] + [u"w] + [nv!™ 

(12) 

d[U X (V X W)1 

di 

- W X (V xW)+Ox«xw) 


The simplest example of a vector function of one variable is 
the set of vectors drawn from the origin to the points of a c4irve 
C on which the scalar variable t is :i parameter For a general 
point on C IS associated with a unique value of the parameter, 
say t = i\, and determines with (he origin a unique vector V(^) 
(Fig 12 10a). This correspondence between the values of t and 
the vectors V(0 is clearly a vector function of t according to our 
definition. C^onversely, if the values of a continuous vector func¬ 
tion V(0 are drawn from a common origin, their end points will 
define a curve C whose points will be in correspondence with the 
values of the scalar variable t 

This point of view leads to an important geometric interpreta¬ 
tion of the derivative (fS/di For, since tit is just a scalar, the 
quotient tiV /is a well-defined vector having the same direction 
as AV itself Moreover, as Kig. 12 106 show^s, the direction of AV 
IS that of an infinitesimal chord of the curve C Therefore, as A^ 
approaches 0, the direction of AV, and, hence, the direction of 
AV/Af, approaches the direction of a tangent to C That is, (IS jdi 


FIGURE 12 10 
The geometrical 
interpretation of 
a vector function 
of one variable 
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18 a vector tangent to the curve C which is the locus of the end points of 
the vectors V(t) In particular, if the scalar variable t is taken to be 
the arc length s of C, measured from some reference point on C, we 
have 

infinitesimal chord of C _ ^ 
infinitesimal arc of C 

Hence, if s is the arc length of the curve C defined by the end points of 
the vectors V(s), then dW/ds is a unit vector tangent to C. 


dV 

= lim 


ds 

A*—*0 

As 


EXAMPLE 1 

At what point or points is the tangent to the curve x — v “ 10< perpendicular to the 

tangent at the point where r = 1? 

From our earlier discussion it is clear that the given curve is etjuivalent to the vector 
function 

V(n = th -i- 10<k 

Moreover, the tangent to this curve at a genend point i is 

dV 

— = 3/h + 100 + 10k 
at 

and, in partuular, at < 1 the tangent is 

3i -f- lOj -h 10k 

Using the fact it two nonzero vectors are perpendicular if and onlv if their dot product van¬ 
ishes, it follows that the tangent at a general point I will be perpendicular to the tangent at the 
point < » 1 if and only if 

3(3U; + 10(100 + 10(10) s Of’ + lOOf -h 100 = 0 

This condition holds for the two values t = ——10 Hence, evaluating the x, y, and z 
coordinates of the points with these parameters, it follows tliat the tangent at 

( 1,0^^ 500 _ 1(K)\ 

720”' 81 ' ~ 9 / 

and the tangent at ( — 1,000, 500, - 100) are both perpendicular to the tangent at f “ 1 and that 
these are the only points with this property 


EXAMPLE 2 

Disniss from the point of view of vei*tor analysis the problem of the determination of the velocity 
and acceleration of a particle moving along a eurve (' 

To do this, let us suppose that the path C, which is the locus of the instantaneous positions 
of the moving particle, is defined by the vector function P(f), where t is the time In other words, 
P(f) IS the vector drawn from the' origin to the position of the moving particle at the general time t 
Now' let .1 be the arc length of C Then, by the chain rule, wo can write 


(1.3; 


dP dP ds 

SS -- 

dt dft dl 


Since d^/dt is the speed v of the movung particle and sinee dP/ds is a unit vector tangent to the 
path of the particle, it follows from (13) that the vector 

dP 


( 14 ) 
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agrees both in magnitude and in direction with the velocity of the particle and, thus, can properi> 
be called its vector velocity. 

Moreover, if we define the vector acceleration of the particle as the time derivative of its 
vector velocity and, for convenience, denote the general unit vector tangent to (7, namely, dp/f/.*- 
by the symbol T, so that (14) becomes 


V — vT 

we can write 

dy ^vT) 
dt dt 

(15) 


dv 

dT 

dv 

dT da 

— T + e 

— 

= - T 

+ v - 

dt 

dt 

dt 

ds dt 



dv 

dl 



-T 

4- y* - 



dt 

ds 


In the first term on the right in (15) the scalar quantity dv/dt is the rate of change of thr 
tangential speed v Therefore, since T is by definition a unit vector tangent to C, tlip jiiodurt 
(dv/dt)T is in magnitude and direction just the tangential acceleration of the moving particle 
To interpret the second term on the right m (15), we observe that, since T is a unit vector, it 
can vary only in direction Hence, if the various values of T are drawn from a lonunon origin, 
the locus of their end points will be a curve on n sphere of unit radius Now the length of the 
increment (Fig 12 1 lb) is approximately the length of the arc* A 'IV, which in turn is equal tc 


FIGURE 12.11 
The unit tan¬ 
gents to a space 
curve plotted 
from a common 
origin. 


T-t-AT 



(a) 



where Atf is the angle between the tangents to C at the points .1 and /f, a distance A.*? ajinil 
(Fig 12 11a) Hence, 


dT jATj angle between tangents to (' at A and B 

— = lirn - , = lim - -- - - 

ds I |A«| a«-»o arc length along C betw een .1 and B 


■» curvature of C 


Moreover, from Fig 12 11b it is evident that the limiting direction of AT is perpendicular to T 
in the plane w Inch T and T -f AT deterimne in the limit If (’ is a plane curve, this, of course, is 
the unique plane m which C lies If (' is a twisted curve, this plane, which is known as the 
osculating plane, will vary from point to point along C Hence, to summarize, dT/ds i.s a vector 
perpendicular to C in the osculating plane of w hose magnitude is eciual to the curvature A of ( 
If, finally, we let N denote a unit normal drawn toward the concave side of C in the oscuhitinii 
plane and define the radius of curvature of C as 
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we can write Eq (15) in the form 
dv y® 

winch shows that at any point in its path, the vector acceleration of a inovinq particle m the sum of a 
component of magnitude dv/dt along the tangent to the path and a component of magnitude v^fp 
normal to the path in the osculating plane to the path 


EXERCISES 


1 If P = A cos kt B sin kt, whore A and B are arbitrary constant voctoi.., show that 
P X dP/dt IS a constant and that W^P/df^ -}- k^P =» 0 


2 If P IS any vector, show tiiat 


dt 


/ dP\ d*P 

P X — ) = P X ' 

\ dt / dt^ 


3 What iH the derivative (a) of U ■ — X Mb; of U X 

dt df^ 

4 If V is an arbitrary vector function of t, is IdVl = d!V|? 

6 If V IS an arbitrary function of t, show that V = f' 

dt dl 

6 What IS the anple between the tan^ijents to the (iirve f = t, // = z = at the points 
where t = I and t — —1? 

7 SJiow that there are no pairs of points on tin- curve j- = t, // = c = /’ at whi('l) the tan- 

KOTits are parallel Are there such pairs of points on the eur\e j ■= 'M* - bf + 12t, ?/ = It’ — 

6/*, z — r2t'^ on the curve j = 15t, q — r>t^, z = I Tit -f 

0 If R = td /I*j + IS tlie vedoi from the oiiKin to a movinp paitule, find tlie resultant 

velocity of the particle when t = 1 Whnt l^ llie coiiiponeiit of this velocity in the direction 
of the vector 8i — J -|- What is the vector luccleration of the particle'^ What art' tile 
tangential and noimal (oniponents of its acceleration? 

9 If a particle starts to move from rest at the {loint (0,1,2) with component acceleralions 
= 1 4 2t, fly = (iz = 2t - t‘, find the vector from the origin to the instantaneous 
position of the particle 

10 If Ri, Rj, j R„ are the vectors fioni the oiigin to the respective mass particles mi, 


/ dU 


nil, , m„, the end point of the vector 


^ miRi 



is calh'd the center of gravity of the system of particles Show that, for any vector R, 

n n 

V m4R - R,) • (R - R,) = m(R - C) (R - C) 4- £ w fC - R,) ■ (C - R.) 

,=i »-l 

where m is the total mass of all the particle's 

If a particle moves under the mfluimee of a force F which is always directed toward the 
origin, show^ that R X d^R/dt^ = 0, where R la the vc'ctor from the origin to the particle 
(Hint* Newton’s Jaw, i c , mass X acceleration = force, remains correct when the accelera¬ 
tion and the force are interpreted as vc'ctor quantit es ) 

12 If R(<) la the vector from the origin to the instantaneous position of a particle moving along 
a curve C, show' that R X dR is equal to twice the area of the sector defined by the two 
vectors R(/) and R(< -|- d() ^ R 4 dR and the arc of C winch they intercept Hence show 
that fa) if R X dR/dt “ 0, the vector R has a constant direction, and that (b) if R X 
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d^R/dt^ — 0, the particle moves so that the radius vector R sweeps out equal areas in equal 
times. (Property b is a generalization of one of the laws of planetary motion discovered by 
Johannes Kepler (1571-1630) ] 

18 IfT is a unit vector tangent to C and if N is the unit normal to C in the osculating plane, the 
vector B — T X N IB called the binormal to C at the point where T and N are drawn Using 
the fact that dT/ds =■ N/p, show that dB/ds - T X dN/ds and hence that dB/ds has the 
same direction as N (The absolute value of dB/ds is called the torsion of the curve (1 and 
measures the rate at which the osculating plane turns as we move along C ) 

14 What IS the equation of the osculating plane to the space curve t = y « « t* at the 
point Pi {xi,yi,Zi) whose parameter is t » U? [Hint Let P (x,y,z) be a general point in the 
osculating plane, and impose the condition that the vector joining P to Pi be coplanar with 
the vectors T and dT/d< at Pi ] 

16 What 18 the osculating plane to the curve x ^ t,y =^ 1^,2 = P at the point whose parameter 
IB t? What is the normal to this curve at the point ^ 1? What is the bmormal at i 


12.3 

The operator V 


Let (t>(x,y,z) be a scalar function of position possessing first partial 
derivatives with respect to x, y, and z throughout some region of 
space, and let R = ri 4- i/j + 2 k be the vector drawn from (ho 
origin to a general point P (x,y,z) If we move from P to fi 
neighboring point Q {x 4- At, y 4- A^/, z 4- As) (Fig 12 12), the 
function 0 will change by an amount A0 whose exact value, as 
derived in calculus, is 

(1) A<^ = ^ At 4- Ai/ 4- A2 4“ fi At 4- f2 A?/ 4- «3 A 2 

oT oy oz 

where ei, < 2 , ta are quantities which approach zero as Q approacln s 
P, 1 e , as At, Ay, and Az approach zero If we divide the change 
A4> by the distance As = |AR| between P and Q, we obtain a 
measure of the rate at which changes when we move from P 
to Q 

/r»\ A</> At , d<f) Av , 60 Az . At , Ai/ , Az 

-T = X “h ^ r —h \ ~r Cl -r-F ^2 c 1 * 

As ax As ay As dz As As As As 

For instance, if <t>(x,y,z) is the temperature at the general point 
P {x,y,z) then A0/ A« is the average rate of change of leniperatiiiT 
in degrees per unit length at the point P in the direction in which 
As is measured The limiting value of A0/As as Q approaches P 


FIGURE 12.12 
The coordinate 
vectors of two 
neigh bormg 
points 


Q (xH Aa, y+Ay, 2 +2^z) 



R+AR 
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along the segment PQ is called the derivative of ^ in the direction 
PQ or simply the directional derivative of 0 Clearly, in the limit 
the last three terms m (2) become zero and we have explicitly 

_ d^dz ^ d<t> dy d<l> dz 

ds dx ds ~dy da dz da 

The first factor in each product on the right m (3) depends 
only on and the coordinates of the point P at which the deriva¬ 
tives of <t) are evaluated The second factor in each nroduct is 
independent of </> and depends only on the direction m which the 
derivative is being computed This observation suggests that 
d(t>/ds can be thought of as the dot product of two vectors, one 
depending only on 0 and the coordinates of P, the other depending 
only on the direction of da, and in fact we can write 



The vector function 


(4a) 


^ i -L ; _L k 
dx dy^ dz^ 


IS known as the gradient of 0 or simply grad (^, and in this nota^ 
tion (4) can be rewritten in the form 


- = (grad^).^ 


To determine the significance of grad 0, we observe first that, 
since As is by definition just the length of AR, it follows that dR/da 
IS a unit vector Hence the dot product (grad 0) • (dR/da) is just 
the projection of grad 0 in the direction (;f dR/da Thus, according 
to (4a), grad 0 has the property that Us projection in any direction 
IS equal to the derivative of 0 in that direction (Kig 12 13a). Since 
the maximum projection of a vector is the vector itself, it is clear 
that grad 0 extends in the direction of the greatest rate of change of 0 
and has that rate of change for its length 

If we set ip(x,y,z) = c, we obtain, as c takes on different 


figure 12.13 
The geometrical 
interpretation of 
the gradient. 



Grad 0 
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(5) 


(6) 

(7) 

(8) 
(9) 


values, a family of surfaces known as the level surfaces* of 
and, on the assumption that 0 is a single-valued function, one and 
only one level surface passes through any given point P If we now 
consider the level surface of 4> which passes through P and fix our 
attention on neighboring points Q which he on this surface, we 
A0 

have ^ = 9, since A<^ = 0 because, by definition, 0 has the same 
value at all points of a level surface Hence, by (4a), 

(grad 0)-g = O 


for any vector c/R/d« which has the limiting direction of a sccanl 
PQ of the level surface. Clearly, such vectors are all tangent to 
4> — c at the point P; hence, from the vanishing of the dot 
product in (5) it follows that grad <t> is perpendicular lo cv(My 
tangent to the level surface at P In other words, the gradient of d) 
at any point P ts perpendicular to the level surface of <{> which pams 
through that point (Fig 12 136) Evidently, grad </> is related to (he 
level surfaces of 0 in a way which is independent of the particular 
coordinate system used to describe 4> In other words, grad </> 
depends only on the intrinsic properties of 4> It follows, therelorc 
that in the expression 


grad,^ = gi + 


d<f) . , 


dz 


i, j, and k can be replaced by any other set of mutually perpen¬ 
ds d<f> d0 

dicular unit vectors provided that —> —) — are rephu'ed by tin' 

dx dy dz 

directional derivatives of 0 along the new axes 

The gradient of a function is frequently written in operational 
form as 

grad0 = (i|+jA + k|)^ 

The operational “vector” thus defined is usually denoted by I be 
symbol V (read “del”) 


.a , ,a , , a 

In this notation our earlier results can be written 

grad 


B V<^ 


ds 

dR 


* This name, which is used regardless of the number of independent vanablea, 
18 suggested by the analogy between the general case and the two-dimension« 
topographic interpretation in which is the elevation at the point 

and the loci 4f(x,y) — c are the contour lines, i e., curves consisting of pointn 
where the elevation above (or below) the xy-plane is constant 
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( 10 ) 


Also, if ^ IS a function of u and u is a function of x, y, and x, then 




d4> du . 
du dx 


d(f> du . 
du dy ^ 


d4> du , 
du dz 


d4> (du . du . \ 


d4> _ 
= - 7 ^ Vu 
du 


What IS the directional derivative of the function t)i(x,y,z) = xy^ f- ra the point (2, -1,1) 
in tlie direction of the vector 1 + 2j -}- ‘2k‘^ 

Our first step nni.st he to find the gradient of t/> at the point — 1,1) This i,s 

d(Ty'^ -f ifz^) d(xy" h 1/2*) 0{xy^ H 7/2*) I 

V<^ =- ^ - _ j - 

dx dif dz I2, — 1.1 


= yh -f (2xy + z^)j + 37/2®k 
= i - 3j - 3k 


2 ,- 1.1 


The projection of this in the direction of the jfiveri vector will he tlie required diiectioiiiil 
dcrnative Since this projection can he found at once as the clot product of V(/> and a unit vector 
in 1 lie jz;iven direci <n, \\ e next reduce 1 4 2j -f- 2k to a unit vector hv diviihnfj; it hy its ina|?uitude, 
petluiK 


1 + 2j_+J2k 
\/l + 4"4 4 


I 2.2 


The answer to our prohlern is, therefore, 

Oil + 23J + 2 .,kj (1 - 3 j - 3 kj OV + h} + 23k) - -113 

I'he nt'j^rativc sign, of course, indicates that 0 decreases in the gi\en dircftion 


EXAMPLE 2 

Wluit is tlie unit normal to the suifac'e — 1 it tlie point ( — 1,-1,2)? 

het us regard the given surface a.s a jjartieulai le\ el surface ot the lunetion = xy^z"^ Then 
the gradient of this function at the point ( 1,- 1,2) will he perpendicular to the level surface 

through (- whic-h is the given surtaee When the gradient has been found, the unit 

normal can he obtained nt once hy dividing the gradient by its magnitude 

V<t> = y^zH h 3 x7/'^2*J 4 2xy^zk ^ ^ ~ ^ 

jv^l = ^ 16 = 4 V11 

V<t> — 4i — 12j+4k 1 . 3 ^ 1 ^ 

i^'^i ” 4 \/i I vn 'vti ‘ Vh 

It may he necessary to reverse the direction of this result by multiplying it by — 1, depending on 
'vhic-h side of the surface W'e wish the normal to extend 

The vectoi character of the operator V suggests that we also 
consider dot and cross products in which it appears as one factor. 




514 


VECTOR ANALYSIS 


CHAP. 12 


( 11 ) 


( 12 ) 


If F = Fii + F 2 j -h Fjk is a vector whose components are func¬ 
tions of I, y, and z, this leads to the combinations 

^ dFi . dFi , ^Fi 

which is known as the divergence of the vector F, and 



i- + kA' 

dy^ dz, 

j X (Fii + F2j + Fak) 

(aF, 

aft 

)-'( 

'dFa dFA /dF2 
^dx dz J ^ \ dx 

\ay 

dz 

i j 

k 



A ^ 

d 



dx dy 

dz 



Fi Fi 

Fa 




which is known as the curl of F 

Both the divergence and the curl admit of physical interpreta¬ 
tions which justify their names For instance, to illustiate llie 
significance of the divergence, consider a region of space filled 
with a moving fluid, and let 

V = vii -1- V2i + t/ak 

be a vector function representing at each point the velocity with 
which the particle of fluid instantaneously at that point is moving 
If we fix our attention on an infinitesimal volume (Fig 12 14) in 
the region occupied by the fluid, there will be flow through each 
of its faces, and as a result the amount of fluid within the element 
may vary To measure this variation, let us compute the loss ot 
fluid from the element in the time M 

Now, the volume of fluid which passes through one face of 
the element AV m time At is approximately equal to the com¬ 
ponent of the fluid velocity normal to the face times the area of 
the face times At, and the corresponding mass flow is, of couisc, 
the product of this volume and the density of the fluid p Hence, 
computing the loss of fluid through each face in turn, reiiiembering 
that since the fluid is not assumed to be incompressible the density 


FIGURE 12.14 

A typical volume 
element in a 
region filled with 
a moving fluid 
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as well as the velocity may vary from point to point, we have 

Right face: Aj/j lix A« M 

Left face: 

Front face j^p^i 4- j 

Rear face; —pviAy^zAt 

Az j Ax Ay At 
Bottom face —pv^ Ax Ay At 

If we add these and convert, the resulting estimate of the absolute 
loss of fluid from AF in the interval At into the loss per unit 
volume per unit time by dividing by AT A^ s Aj Ay Az At, we 
obtain in the limit 

Rale of loss per unit volume = r-—-r-1-^— 

Bx dy dz 

which IS precisely the divergence of the vector pv. Thus fluid 
mechanics affords one possible interpretation of the divergence as 
the rate of loss of fluid per unit volume. 

If the fluid IS incompressible, there can be neither gain nor 
loss of fluid in a general element. Hence, since the density p is 
constant for an incompressible fluid, we must have 

V • (pv) = pV • V = 0 or V • V = 0 

which is known as the equation of continuity for incompressible 
fluids However, if AV encloses a .source of fluid, then there is a 
iict los.s of fluid through the .surface of AF equal to the amount 
diverging from the source Similar results, of course, hold for such 
things a.s electiic and magnetic flux, which exhibit many of the 
properties of incompressible fluids 

To find a pos.sible interpretation of the curl, let us consider a 
body rotating woth uniform angular speed w about an axis 1. Let 
us define the vector angular velocity Q to be a vector of length oj, 
extending along / in the direction iii which a right-handed screw 
would advance if subject to the same rotation as the body 
Finally, let R be the vector drawn from any point 0 on the axis I 
to an arbitrary point P in the body. 

From Fig 12 15 it is evident that the radius at which P 
rotates is |R| |sin 0|. Hence, the linear speed of P is 

|v| = a,|R| Isin e\ = |a| |R| ■ |sin 0| = [Q X R| 

Moreover, the vector velocity v is directed perpendicular to the 
plane of Q and R, so that Q, R, and v form a right-handed system. 
Hence, the cross product Q X R gives not only the magnitude of 

V but the direction as well. 


Top face; pi^a + 

L dz 


9S6 


FIGURE 12.15 
A physical inter 
pretation of the 
curl. 


Now, if we take the point 0 as the ongin of coordinates, we 
can write 

R = ji + t/j + 2k and Q = nd + + flak 

Hence, the equation v = ft X R can be written at length in tlie 
form 

V = (fl22 — flay)i — (fli2 — flax)] -f (fli?/ — fl2x)k 



If we take the curl of v, we therefore have 

i j k 

„ a d a 

ox oy dz 

il.2Z — ihy — (51i 2 — ilaj) 111!/ — ihx 
Expanding this, remembering that ft is a constant vector, we find 
V X V = 2f2ii 4- 2f22j 4- 2fl3k = 2ft 
or ft = X V 

The angular velocity of a uniformly rotating body is thus equal 
to one-half the curl of the linear velocity of any point of the body 
The aptness of the name curl in this connection is iippai ent 

The results of applying the operator V to various combinat ions 
of scalar and vector functions can be found by the following 
formulas * 


(13) V • (<^v) = • V 4- V • V0 

(14r) V X (0v) = 0V X V 4- (V0) X V 

(15) V-(uxv) = v- V xu-u-Vxv 

(16) V X (u X v) = V • Vu — u • Vv -H uV • V “ vV • u 

(17) V(u • v) = u • Vv 4- V • Vu -f u X (V X v) 4- V X (V X u) 

(18) V X V(^ =0 

(19) V • V X V = 0 

(20) V X (V X V) = V(V • v) - V • Vv = V(V • v) - V*v 


* We must remember, of course, that these results are correct only for the 
cartesian form of the operator V given by Eq (6). Different formulas arise 
when V is expressed in terms of more general coordinate systems. 
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These identities can all be verified by direct expansion For 
instance, to prove (13), we have 


V * (0v) = V ■ [0(i;ii -h V 2 j H- yak)] 

= _L ^(<^2) I ^(^ya) 

dx dy dz 


dv\ dv 2 , d4> 

ox dx dy dy 


^ dl'a , 

4> + V, 


d<^ 

dz 


which, on regrouping, is simply 


■ V + V ‘ y<^ as asserted 

In general, however, it is easier to establish formulas like 
those in the above list by treating V as a ve‘’tor, mampiilatiiig the 
expressions according to the appropriate formulas from vector 
algebra, and finally giving V its operalional meaning. Sinee r is a 
linear combination of scalar differential operators winch obey the 
usual product rule of differentiation (that is, act on the faiitors m 
a product one at a time) it is cl(‘ar that V itself has tins propeity 
In other words, we can apply V to products of various sorts by 
assuming that each of the factors m turn is the only one which is 
variable and then adding the partial results so obtained As a 
notation to aid us in determinUig these partial results, it is helpful 
.0 attach to r, whenever it is followed by more than one factor, a 
subscript indicating the one factor upon which it is (‘urrently 
allowed to operate 

To prove (14), using the second, more formal procedure, .e 
suppose first that the scalar funclion 0 is a constant, that is, we 
let V operate only on the vector v Then we can write 

X (0v) = X V 

where the subscript v has been omitted from the right-hand side, 
Since it is always completely clear what V opeiatcs on when it is 
followed by just one factor Similarly, if we regard v as constant 
and as vaiiable, we have 

X (</iv) = X V 

where the parentheses now restrict the effect of V to the factor 
alone and so make a subscript on V unnecessary Finally, adding 
our two paitial results, we have 

V. X (0V) 4- X (0V) - V X (0v) = X V + (V</>) X V 

To prove (ITi), we have, from the cyclic properties of scalar 
triple products, 

Vu • (u X v) = V * V X u and V,, • (u X v) = — u ■ V x v 
Hence, adding these two partial results, we find 

V*(uxv) = v- Vxu — u-Vxv 
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To prove (16), we have 

v„ X (u X v) = (v„ • v)u - (V„ • u)v = V • Vu - vV . U 
and X (u X v) = (V„ • v)u - (V„ • u)v = uV • v - u ■ Vv 

Hence, adding, 

V„ X (u X v) -h X (u X v) BH V X (u X v) 

= V • Vu — u • Vv + uV • V — vV • u 

To prove (17) we note that 

U X (V X v) sa U X (V. X v) = (u • v)V« - (u • V)v 

= V„(u • v) — u • Vv 

and V X (V X u) s v X (Vu X u) = (v • u)V„ — (v • V)u 

= V„(u • v) — V • Vu 
Hence, transposing and adding, we find 
V«(u • v) -f V,(u • v) B V(u • v) 

= u X (V X v) -h V X (V X u) + u • Vv 4- V • Vu 

Without explicit expansion we infer that (18) is correct, since 
the operational coefficient of namely, V x V, is, in effect, a cross 
product of identical factors and hence zero Similarly, without 
expansion, we infer that (19) is correct, since V • V x v is a scalar 
triple product containing two identical factors and hence is zero 
To establish (20), we merely apply the usual rule for expand¬ 
ing a vector triple product 

V X (V X v) = (V • v)V - (V • V)v = V(V • v) - V^v 

where the conventional symbol V* has been substituted for the 
second-order operator 

“ V ^ dy ^ dz) ■ V dx ^ ay ^ dz) 

^ a^ a^ a» 

~ ax* ay* az* 

EXERCISES 

In the following oxeroisee -|- yj -|- zk, as usual, and r -• 1R| “ \/ x* -}- y* -H ** 

1 Prove that V X R « 0. What is V • R? 

S If A is an arbitrary constant vector, prove that V(A ■ R) — A What is (A • V)R? 

8 Compute (a) the divergence and (b) the curl of the vector 
xpzi -h — y*z)k 

4 What 18 the directional derivative of the function 2xy -H z^ at the point (1, —1,3) m 
direction of the vector i -|- 2j -1- 2k? 

5 What is the unit normal to the surface z » x* + y* at the point (1, —2,5)? 

6 What is the angle between the normals to the surface xy ■■ z* at the points (1,4, —2) and 
(-3,-3,3)? 

7 Verify Eqs. (14) and (15) by direct expansion. 

0 What IS the generalization of Eq. (10) to the case in whicli 0 is a function of u, v, and tr, 
where u, v, and tu are each functions of x, y, and z? 
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9 Prove that the curl of any vector whose direction is constant is perpendicular to that 
direction. 

10 Prove that (A X V) X R = -2A What is (A X V) • R? 

11 Prove that V • [(A X R)/r| =» 0 for any constant vector A, 

.u.r,K^/AXR\ A AR 

12 Prove that V X I - I * — a,ny constant vector A 

18 Prove that Vr’‘ -> nr"~*R 

14 For what values of n is W" » o? 

15 Determine n so that V • (r^R) will vanish identically 

16 Prove that the curl of/(r)R is identically zero 

17 Prove that ^^<^1 X V<f,i - y x (</», ^<^ 2 ) - -y x (<^2 

18 If M “ X + 1 / + 2 , u « 2 : + y, and ui « -2x2 - 2pz - 2 *, 8ho'^ that [Vu Vn ^wj] - 0. 

10 If three functions u, v, and w are connected by a relatifj'i f{u,v,w) » 0, prove that 

[yu Vi; yio] 0. (Hint Consider the dot product of V/ and Vu X Vp ) 

20 If V, and V 2 are the vectors which join the fixed points P, (j‘,,y,, 2 ,) and P 2 .(x 2 ,y 2 , 2 i) 
to the variable point P\{x,y z), prove that the gradi“nt of V, • Vj is V, -f W 2 What is 
V * (V, X Vj)? What IS V X (Vi X V*)? 


12.4 

Line, surface, and volume integrals 

In the rest of our work in vector analysis and in much of the work 
ahead of us in the chapters on complex variables, a simple exten¬ 
sion of the familiar process of integration known as line tnUgrahon 
will be of fundamental importance Although in vector analysis 
we are usually concerned with line integrals taken along space 
curves, it is convenient to begin our discussion with a considera¬ 
tion of line integration along plane curves, since the applications 
of line integration in our study of complex variables will be 
exclusively m two dimensions In both the two-dimensional and 
the three-dimensional case, our work will involve only continuous 
curves which are sectionally smooth; that is, curves which are 
continuous and consist of a finite number of arcs on each of which 
the tangent changes continuously Clearly, such curves can have 
at most a finite number of “corners” where the direction of the 
tangent changes abruptly Moreover, as we learned in calculus, 
the length of such a curve between any two of its points is finite 

Let F{x,y) be a function of x and y, and let C be a coutmuous, 
sectionally smooth curve joining the points A and Further¬ 
more, let the arc of C between A and B be divided into n segments 
Ast whose projections on the x- and y-SLxes are, respectively, Azt 
and A2/t, and lot be the coordinates of an arbitrary point in 

the segment As, (I’lg. 12.16) 

If we evaluate the given function F(x,y) at each of the points 


iF{x,y) bearfl no relation to the equation of C and is merely a function 
defined at every point of the portion of the curve C under conaideration. 
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FIGURE 12.16 

The flubdiviflion 
of an arc pre¬ 
paratory to the 
definition of a 
line integral 




and form the products 

Ax, Aij, As, 

and then sum over all the subdivisions of the an; AB, we ha\e 
the three sums 

I; F{i„r,,) Ax. y F(k„v.) A!/, I; a*. 

t -1 t -1 1-1 

The limits of these sums, as n becomes infimte in such a way llial 
the length of each As, approaches zero, are known as line integrals 
and are written, respectively, 

^ F(x.y) dx F(x,y) dy F(x,y) ds 

It can be shown* that the continuity of F{x,y) is a sufficient con¬ 
dition for the existence of the limits which define t hese integials 
In these definitions. Ax, and Ay, are signed quantities, whereas 
As, IS intrinsically positive Thus the following properties of 
ordinary definite integrals 

fB fB 

a / (it — c / <p{t) (it c a constant 

b // [<^i(0 ± «<>,(<)] dt = I" dl ± ^i{l) dl 

c // 4>{l) dt= - // <l,{t) dl 
d *(<) dl + I” «(t) dt = // <I>{1) dt 

are equally valid for line integrals of the first two types, provided 
that throughout each formula the curve joining A and B remain^ 
the same. On the other hand, line integrals of the third type, 


• See, for instance, D V Widdcr, “Advanced Calculus/’ p. 187, Prentice- 
Hall, Inc , Englewood Cliffs, N.J., 1947 
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although they do have properties a and b, do not have property 
c, since, in fact, 

F(x,y) ds = F{x,y) ds 

Moreover, property d holds for these integrals if and only if P is 
between A and JS on the path of integration In general, we shall 
be much more interested in integrals of the first two types than in 
integrals of the third type 

Much of the initial strangeness of line integrals wn. disappear 
if we observe that the ordinary definite integrals of elementary 
calculus are just line integrals in which Uie curve C is the i-axis 
and the integrand is a function of x alone. Moreover, the evalua¬ 
tion of line integrals can be reduced to the evaluation of ordinary 
definite integrals, as the following example shows 


EXAMPLE 1 


- dx along each of the three paths shown in Fig 

^ + y 


What iH the value of 


I 


J2 17? 


FIGURE 12.17 
Three possible 
paths for line 
integration from 
(1,1) to 
(2,4) 



Before this integral can be evaluated, it is necessary that y be expressed in terms of t To 
<lo t h 8, we recall from the definition of a line integral that the integrand is always to be evaluated 
along the path of integration Along </ = this gives us the ordinary definite integral 


n dx n (l 

X -I- j* “ \t 



[In X - In (1 4- I)1J 


In 


4 

~3 


Along Af* the integral is obviously zero, since x remains constant Along PR, on which 4, 
vie have the integral 


! dx 
X -b 4 


[In (i -b 4)lj 


In- 

5 


which 18 thus the value of the integral along the entire path APB. Along AQ, on which i/ * 1, 
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we have the integral 


n dx ,3 

/i + -'”5 

Along QB the integral is again zero Hence, along the entire path AQB the value of the integral 
is In ^ 

This example not only illustrates the computational details of line integration, but also 
shows that in general a line integral depends not only on the end points of the integration but 
also upon the particular path which joins them 


It IS possible, as in the case of ordinary integration, lo 
interpret a line integral as an area For, if we think of the integrand 
function F{x,y) as defining a surface over the a;y-plane, then the 
vertical cylindrical surface standing on the arc AB sls base, or 
directrix, will cut the surface z ~ F{x.y) m some curve such as 
PQ m Fig 12.18, This curve is clearly the upper boundary of the 


FIGURE 12.18 
Plot showing the 
interpretation of 
a line integral 
as an area 



portion ABQP of the cylindrical surface which lies above the 
2:i/-plaiiP, below the surface z = F{x,ij), and between the gen¬ 
erators AP and BQ Moreover, the product F{^,, 7 ),) As, is approxi¬ 
mately the area of the vortical strip of this portion of the surface 
which stands above the infinitesimal base As, Hence, the sum 

i As. 

t-1 

is approximately equal to the curved area ABQP^ and, in the 
limit, the integral 

/c f(x,v) ds 

gives this area exactly. 

In a similar fashion, the product Ax, is approximately 

the area of the projection on the xz-plane of the vertical strip 
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standing on the sum 

n 

J f(i„vO Ax. 

1-1 

represents approximately the area of the projection on the xz~ 
plane of the entire curved area ABQP, and, in the limit, the 
integral 

jc ^(*. 2 /) dx 

gives the projected area exactly. In the same way the integral 
F{x,y) dy 

represents the area of the projection of APQP on the 2 / 2 -plane. 

Although this geometrical interpreiation of line integrals as 
areas is vivid and easily grasped, it obscures the fact that almost 
invariably in applications the function F(x,y) describes some 
physical property of the plane of integration and is actually un¬ 
related to any other region of space 

EXAMPLE 2 

If a particle ig attracted toward the origin by a force whose magnitude is proportional to the 
distance r of the particle from the origin, how much work is done when the particle is moved 
from the poin<^ (0,1) to the point (1,2) along the path y “ 1 "1 J*. oHSurning a roeflicient of 
friction /I between the particle and the path** 

Let $ be the angle which the tangent to the curve at a general point P ix,y) makes with the 
j-axis, let 0 be the angle which the radius vector to P makes with the x-axiN, and let a be the 
angle between the tangent and the radius vector at P (Fig 12 IM) In moving the partu le an 
infinitesimal distance A.s along the path, work must be done against two forces, namely, the 
tangential component of the central force 

F, »*: F cos a = kr cos a 
and the frictional force 

Fj «■ tiPn »" fiF sin « " fikr sin a 

arising from the component of the central force which is normal to the path and which acts to 
press the particle against the path The infinitesimal amount of work done against these forces 


y^x'^ + \ 


y 

j 


/l,2 

figure 12.19 

/ 

The resolution 

/ 

of a central 

// 

force into tan- q ^ 

Pyf^>y 

gential and nor- 


inal components 


along a curve 

1 


^F^kr 

e 
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in moving a distance As is approximately 

fI As + Ff As “ (kr cos a -f- ^kr sin a) As 

Now, from the exterior-angle theorem of plane geometry, a ■ — ff Hence, 

/■ 1.2 /■ 1.2 . ^ 

W k I T cos ( 4 t ~ 0) da fik I r sin (^ — ff) ds 
yo.l Jo A 

/■ 1.2 f \,2 

* ^ io 1 ^ ff -f- sin 0 sin 6) da nk / ^ r(8in 0 cos ff — cos <l> am ff) ds 

But r cos 0 — j r sin 0 » 1 / 

and cos B da ™ dz sm 6 da = dy 

Hence, substituting these into the last expression for W, we have 

^ ^ Jo 1 y ^ Jq I (y dx - X dy) 

The first of these integrals can be written very simply as 


k fh2 

2L 


which, independent of the path, is just 


2 


The second integral is not an exact differential, and thus, os usual, due account must be 
taken of the path Now, along the path, y = + 1 and x = \/y — 1 Hence, 

yik (ydx - X dy) “ {x’ + 1) dx - pk \/y - 1 dy 

“ [?+*]o" ■ ~t 

The total amount of work done in the course of the motion is therefore 


The first term represents recoverable work stored as {wtential energy , the second term represent.^ 
irrecoverable work dissipated as heat through friction 

The extension of line integration to paths m three dimensions 
IS easily accomplished Let F{Xjy,z) be a continuous function of 
X, y, and 2 , and let C be a continuous, sectionally smooth curve 
joining the points A and B Furthermore, let the arc of C between 
A and B be divided in an arbitrary manner into n subintervals 
As, whose projections on the coordinate axes are Aj., Ay,, and Az,, 
and let an arbitrary point P, (fM’yuL) chosen in each As^ 
We now evaluate F(x,y,z) at each of the points P. and form the 


n n n n 

^ Ax. 2 A!/. ^ Ax. y 

• -1 t-1 l-a 


A.t, 
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The limits of these sums as n becomes infinite in such a way that 
the length of each As, approaches zero define the respective line 
integrals • 

Ic f'(x,y,z) dx F(x,y,z) dy F{x,y,z) dz F{x,y,z) d." 

Because of the difficulty of defining a space curve C as the 
intersection of several surfaces, it is customary to use a parametric 
representation for C. Hence, line integrals in three dimensions are 
ordinarily evaluated by integrating in terms of the parameter on 
C after the variables in the integrand have been replaced by their 
expressions m terms of the parameotr. 

EXAMPLE 3 

What 18 (xy + 2 ^) ds, where C js the arc of the helix 

X = cos t y ^ mn t z ™ t 
which joins the points (1,0,0) and ( —l,0,x)? 

Since {dsy = (dx)* + {dy^ + (dz)* 

and since dx = -- sin t dt, dy — cos t dl, and dz * dt, we have at once 
ds * \/ sin* t H- COR* < -f 1 \dt\ — \/2 \di\ 

Furthermore, it is clear that the point 0,0,0) corresponds to the parametric value t •» 0 and 
that the point ( — l,0,7r) conesponds to the parametric value i! = it lienee, exjireRsing the 
integrand in terms of the parameter /, the required integral heconics 

/- /- Tcos* f \/2 X* 

(cos / flin r 4- ^*) V 2 df -= V 2 ---- + — 

The concept of a line integral generalizes at once to surface 
and volume integrals To descrilie the former, let F{r,y,z) bo a con¬ 
tinuous function of j, i/, and z, and let S be a given regular* surface 
or portion of a regular surface in the region of definition of F{x,y,z) 
Let S be subdivided in an arbitrary manner into n elements AS, 
(Fig 12 20), and m each element let an arbitrary point 
be chosen Finally, let F{x,y,z) be evaluated at each of the points 
P,. Then the limit of the sum 

n 

1-1 


* A surface is said to be smooth if at each of its points there exists a tangent 
plane which vanes continuously as the point vanes continuously on the 
surface A smooth surface is said to be orientable if it is two-sidecf; that is, 
if it IS possible at each point to identify consistently a unique direction nor¬ 
mal to the surface A surface which can be subdiviaed by a finite number of 
sectionally smooth curves into pieces each of which is orientable (and there¬ 
fore smooth) 18 said to be regular. For a discussion of smooth surfaces which 
are not regular, that is, smooth one-sided surfaces, see, for instance, Richard 
Courant and Herbert Robbins, “What Is Mathematics?’', pp 259-264, 
Oxford Book Company, Inc., New York, 1951 
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NGURE 12.20 
The subdivision 
of a surface 
preparatory to 
the definition of 
a surface integral, 



as 71 becomes infinite in such a way that not only the area of each 
but also its maximum chord approaches zero, is the surface 

integral 

jl^Fix,y,z)dS 

Similarly, given a function F(x,y,z) and a region of space V, 
we can subdivide V into arbitrary subregions then evaluate 
F{x,y,z) at an arbitrary point in each AVt and form the 

sum 

n 

.-I 

The limit of this sum as n becomes infinite in such a way that not 
only the volume of each AF* but also its maximum chord ap¬ 
proaches zero, is the volume integral 

fflv 


EXAMPLE 4 

What is the integral of the function over the entire surface of the right circular cylinder of 
height h which stands on the circle x* -H y* — a*? What is the integral of the given function 
throughout the volume of the cylinder? 

To answer the first question, we must perform three integrations, i.e , we must integrate 
separately over the curved surface, the lower base, and the upper base of the cylinder In each 
case, of course, we must employ a subdivision of the appropriate portion of the surface which will 
lead to integrals that can conveniently be evaluated This is most easily done by using polar 
coordinates, as shown in Fig 12 21 Then, on the curved surface, say Si, we have 


and the integral 


dSi ado dz x — a cos 0 z ^ z 
x*z dSi “ Jq Jq 0)^z{a do dz) 


* wa* 



On the lower base, say 5i, we have 

dSt ^ r dr do x ^ r cos 0 z — 0 
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nCURE 12.21 
A typical vol¬ 
ume element in 
cylindrical 
coordinates 



However, because of the factor z, the integrand vanishes identically on St, and without further 
calculations we liave 

On the upper oase, say S,, we have dSi * r dr x = r cos 9, and z h Hence, 

(r cos dr d$) “ COS'* ^ J 


a*h r 9 sin 2^]^' 

T [2 Jo 


ira*h 


The integral over the entire surface S is, of course, the sum of the integrals over Si, Si, and 
»Sg, 1 e , 


//. 


ira*h ira*h(2h -I- a) 

, T^zdS = -- 1-0 +- ----- 

s 2 4 4 


In computing the required volume integral it is also convenient to use polar coordinates 
Doing this, we have dV == r dr d9 dz, x ^ r cos 9, z = z, and the integral 

a* fh r2r 

x^z dV =11 I (r coH 9)h(r dr d9 dz) »■ — / / z cob* 9 d9 dz 

4 JO JO 


III. 


wt 

fh ira^h* 

/ Z dz = — 

Jo 8 


fh 
4 


For the moat part, our interest in line, surface, and volume 
integrals will be theoretical rather than computational, that is, we 
shall use them far more often in derivations than in numerical 
calculation. Fundamental among the theorems we will need for 
this purpose is Green’s lemma/ which relates the line integral of 
a function taken around the boundary of a plane region to the 


Named for the Engliah mathematical physiciat Geoige Green (1793-1841). 




VCCTOR ANALYSIS 


CHAP 12 


surface integral of an associated function taken over the region 
itself: 

THEOREM 1 

If is a plane region bounded by a finite number of simple closed curves* and 
if U(x,y), V{x,y), and ^ are continuous at all points of R and its boundary C, 
then 

Ic = //«(£ " 

PROOF Let us first suppose that the boundary of 7^ is a single simple closed 
curve C with the property that any line parallel to either of the coordinate axes 
cuts it in at most two points, and let us draw the horizontal and vertical lines 
which circumscribe C (Fig. 12 22 ). Then the arcs P 4 P 1 P 2 and P 4 P 3 P 2 define single- 


nouRE 12.22 

A plane region 
and its 
boundary 



valued functions of x, which we shall call/i(x) and/ 2 (j), respectively Similarly, 
the arcs P1P4P3 and P 1 P 2 R 3 define single-valued functions of y, which we shall 
call gi{y) and g^iy), respectively. Now consider 



To carry out this integration over P, it is sufficient to integrate with respect to x 
from the arc PiP^Pa to the arc P 1 P 2 P 3 and then to integrate with respect to y 
from c to d Hence, 




pj(v) dV 


The inner integration can easily be performed, and we find 

h = j* V{x,y) dy = jf Vlgi(y),y] dy - jf V[gi{y),y\ dy 
= j* y[gi{y),y] dy + V[pi(i/),J/] dy 


* For our purfioses it is sufficient to define a simple closed curve as a closed, 
sectionally smooth curve which does not cross itself That this is not the 
whole story, however, can be inferred from the article "What Is a Curve?' 
by G T. Whybum in the Am Math Monthly, vol 49, pp 493 - 497 , October, 
1942 
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Now, the first of these integrals is precisely the line integral 
V{x,y) dy 


taken along the path x = ^2(1/) from Pi to Pa, and the second is just the f ame line 
integral taken along the path x = g^iy) in the direction from P3, through P4, to P^ 
Together, then, they constitute the line integral of V(j y) around the entire closed 
curve C, hence, 

Similarly, if we consider 



we can write more specifically 


n Mx 

'l(x) 


Mx) dU j , 

ay 


Performing the inner integration, we have 

h = f U(x,y) dx = I" (/[x,/,(!)] dx - j' f 7 [x,/,(*)] dx 

= - j° U[xMx)\ dx - j" lJ\xMx)] dx 

The first 01 these integrals is just the negative of the line integral of U{x,y) along 
y = fiM hi the direction from P2 to P4. The second is the negative of the integral 
of V(x,y) along y = fi(x) from I\ to P2 Together they constitute the negi tive of 
the line integral of Ui^x^y) entirely around C in the same direction 111 which we 
integrated in ( 1 ) 

( 2 ) dxdy = - I^^U{x,y)dx 

If we subtract ( 2 ) from ( 1 ) and combine the integrals on each side, we obtain 

( 3 ) [I dx +Vdy= dx dy 


FIGURE 12.23 
A plane region 
fi subdivided 
into aim pier 
regions R,, Rt, 
Ri, Ri 
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which establishes Green’s lemma for the special regions we have thus far been 
considering. 

It is a simple matter, now, to extend Green’s lemma to regions whose bound¬ 
aries do not satisfy the condition that every line parallel to either of the coordinate 
axes cuts them in at most two points. For, if this is not the case, the region R can 
be divided into subregions whose boundaries Ct do have this property. Then 
Eq. (3) can be applied to each subregion, following which the addition of these 
results yields Green's lemma for the general region R itself For instance, for the 
region shown m Fig. 12.23 we can subdivide as indicated and then apply Eq. (3) to 
each subregion, getting 

jr 

t; j. + V - //„ f II - * 

j,Viz + Vd,. 

L'^d. + Vdy. jjJ^^-^-dy.dy 

When these results are added, the four integrals on the right combine to give 
exactly 



since Ri R^ + R^ R^ = R Moreover, the four line integrals on the left 
combine to give the line integral around the two curves which form the boundary 
of R pliLS a set of line integrals taken along the auxiliary boundary arcs P,Q. 
Since U and V are continuous throughout P, these integrals cancel in pairs, 
however, since each of the segments P^Q^ is traversed twice in opposite directions 
Hence we are left with 

j^Udx +Vdy= - ^)dxdy 

which is the assertion of Green's lemma 

The direction in which it is necessary to integrate around 
C, in order for Green's lemma to be correct as we have stated it, 
IS characterized by the fact that an observer moving along C m 
this direction always has the interior of the region R on his left. 
This direction is called the positive direction of traversing C. 

EXERCISES 

1 Diflcuss the extension of Green’s lemma to regions whose boundaries contam segments 
which are parallel to one or the other of the coordinate axes 

2 Evaluate ^ {2xy — 1) di (i* -h 1) dy along the paths y ^ x \ and y - {x*/2) + 1 

8 Evaluate Jx^* da around the circle x* -1- y* — 1 (Hint; Use polar coordinates.) 

/■i.o 

4 Along what curve of the family y - ibx(l — x) does the integral / ^ y{x — y) dx attain its 
largest value? 
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6 Evaluate / ^ ^ (•) along the x-axia and (h) along v - 1 — x*. 

fi,i 

6 Evaluate / ^ x ds along the paths y ^ x, y ^ x^, and y — i*. 

7 Evaluate (x + y)^ dS, where S is the surface of the cube whose vertices ere (0,0,0), 
(1,0,0), (1,1,0), (0,1,0), (0,0,1), (1,0,1), (1,1,1), and (0,1,1) 

6 Evaluate +1/ "I" where S is the portion ot the surface of the sphere x* -|- 

]y* + z* " a* which lies in the first octant (Hint* Use spherical coordinates.) 

9 Evaluate Jjjy dF, where V is the volume under the surface x* -f- v* 4- ** " a* and 
above the xy-plane 

10 Verify Green’s lemma for the integral /(x* y) dx — xy'^ dy, taken around the boundary of 
the square whoso vertices are (0,0), (1,0), (1,1), and (0,1) 

11 Verify Green’s lemma for thf integral /(x - y) dx 4 (x v) dy taken around the boundary 
of the finite area in the first quadrant between the curves y <*• and v* " 

12 Verify Green's lemma for the integral f(x — 2y) dx j dy taken around the circle x* + 


18 If a particle is attracted toward the origin bv a force proportional to the nth power of the 
distance from the origin, show that the work ilone agjunst this force in moving the particle 
from the point (jo,Vn( to the point (Xi,i/)) i.s indejrendent of the path, and find its amount. 

14 A particle is attracted toward the origin by a force proportional Uj the cube of the distance 
from the origin How' much work is done in moving the particle from the origin to the point 
(1,1) if motion takes plio e (a) along the path y = x, (b) along the path y »• x*, (c) along 
the x-axi'' to (1,0) and then vertically to (1,1), and (d) along the y-axis to (0,1) and then 
horizon lly to (1,1), and if in each case the coefficient of friction between the particle and 
the path is 

16 If r, V, and — are continuous and if —“ — at all points in the interior of simple 
dy dx dy dx 

closed curve (\ show that V dx V dy =0 for any Fimple closed curve F which lies 
entirely within C 

16 Show that Cireon’s leniina fails to hold for the functions 


if /? IS the interior of the circle C x* + y ’ * 1 Explain 

17 Using (ireen’s lemma, show that the area bounded by any simple closed curve C is given by 

the formula A = ~ V dx. Is this formula correct for regions bounded by more 

than one simple closed curve'*’ 

18 Using tireen'fl lemma, establish the formula 


JJr \dx* dy^ J dn 


where R is the region bounded by the simple closed curve C, and — is the directional 

dn 

derivative of F in the direction of the outer normal to C 

18 By setting f/ — / — and V * / -- in Green's lemma, show that 
dx dy 


J Jr \ dx dy dy dx J 




where R la the region bounded by the simple closed curve C What ib df? 

30 By setting (J f — and V —/ — m Green's lemma, show that 

dy dx 


JJR ^ \dj* dy*/ JJR \dx dx dy dy) Jc 


Jc dn 


where R is the region bounded by the simple closed curve C, and — is the directional dcnv- 

dn 

ative of g in the direction of the outer normal to C 


12.5 

Integral theorems 

The integrals we encounter in vector analysis are in most cases 
scalar quantities For instance, given a vector function F(j,zy,z), 
we are often interested in the integral of its tangential component 
along a curve C or in the integral of its normal component over a 
surface S In the first case, if R is the vector from the origin to a 
general point of (?, so that dR/ds = T is the unit vector tangent to 
to C at a general point, then F • T is the tangential component of 
F and 

1 ^, F • T F ■ ^ rfs 

(1) = I^F-dR 

is the integral of this component along the curve C In the second 
case, if N is the unit vector normal to iS at a general point, then 
F-N IS the normal component of F and 

(2) /i ^ N 

IS the integral of this component over the surface S Other scalar 

integrals of frequent occurrence are the surface integral of the 
normal component of the curl of F 

( 3 ) (V X F) • N rfS 

and the volume integral of the divergence of F 

( 4 ) [jj^V.FdV 

Fundamental in many of the applications of vector analysis 
IS the so-called divergence theorem, which asserts the equality of 
the integrals ( 2 ) and ( 4 ) when V is the volume bounded by the 
closed regular surface S: 


t Some writers denote the differential vector N dS by the symbol d8 or dA 
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theorem 1 

If ¥{x,y,z) and V • F are continuous over the closed regular surface S and its 
interior V and if N is the unit vector perpendicular to 5 at a general point and 
extending outward from S, then 

//^N.FdS= ///.V-FdK 


PROOF To prove this theorem, we shall first suppose that is a closed surface 
such that no line parallel to one of the coordinate axes cuts it in more than two 
points Now, if F = wi -f ?'j + i/;k, the assertion of the theorem can be written 
at length in the form 


g «■(» + ■) + ..) IS . ///, (H +1 + f) .If- 


or 

O';) 




We shall establish ( 5 ) by proving that lespectiv^e integrals on each side are equal. 
To do this, let us consider first the integral 


///.s 


dV 


Under our c sumption that no line parallel to one of the coordinate axes meets S 
in more than two points, it follows, in particular, that S is a double-valued surface 
over its projection on the x^-planc and, hence, can be thought of as consisting of a 
lower half, say >Si, and an upper half, say S2 Then, if we take dV = dx dy dz and 
perform the z-mtegration first, we have 

(6) f f ^ dz dx dy = f f (w\ — v; I ^ dx dy 

J J Jz on Si Sz J J y |on 6'i |on S\ j 

where, of course, x and y range over the area m t he jy-plane which is the projection 
of S Moreover, the elements dSi and dS2 can be defined so that they have dx dy 
as their common projection on the xy-plane (Fig 12 24 ) Now k * Ni and k • Na 


FIGURE 12.24 
Integration in 
the z-direction 
from )Si to Si m 
the proof of the 
divergence 
theorem 
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are, respectively, the cosines of the angles between the normal to the xy-plane k 
and the outer normals to dSi and dSi; that is, they are numerically the cosines of 
the angles through which dSi and dS2 are projected onto the element dx dy. Hence, 

dxdy ^ —k • T^idSi 
- k • N, dSi 

where the minus sign is necessary in the first equality because the outer normal 
Ni to d5i makes an angle of more than 90® with the direction of k and thus k • Ni 
is negative, whereas both dx dy and dSi are clearly positive Therefore, substituting 
for dx dy in the right-hand side of (6), that is, transferring the integration from the 
common projection of Si and /Si back onto S\ and S^ themselves, we have 

///v S Ln dy- II w dx dy 

= ff w\ k-W,dS, + ff w\ „ k-NidS, 

J J |on Si J J |on S\ 

= ll^^wk-ff dS + II wk • N dS 

where the subscripts have been dropped from the integrands as superfluous, since 
the ranges of integration are now explicitly indicated. Finally, since Si and 
together make up the entire closed surface /S, we can combine the last two integrals, 
getting 

///vS 

Similarly we can show that 

Adding the last three equations, we obtain the expanded form ( 5 ) of the divergence 
theorem, under the assumption that S is exactly two-valued over its projections 
on each of the coordinate planes 

On the other hand, if S does not have this property, we can always subdivide 
its interior into regions 7 , whose boundaries S, do have this property Then, 
applying our limited result to each of these regions, we obtain a set of equations of 
the form 

llm-¥dS= ///;,. V-FdF 

If these are added, the sum of the volume integrals is, of course, just the integral 
of V • F throughout the entire volume V The sum of the surface integrals is equal 
to the integral of N • F over the original surface S plus a set of integrals over the 
auxiliary boundary surfaces which were introduced when V was subdivided These 
cancel in pairs, however, since the integration extends twice over each interface, 
with integrands which are identical except for the oppositely directed unit normals 
they contain as factors Thus, our proof can be extended to volumes bounded by 
general closed regular surfaces, and Theorem 1 is established. 
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EXAMPLE 1 

Prove that XV dS - V X V dV 

To show this, let us apply the divergence theorem to the vector F X C, where C is an 
arbitrary constant vector Then 

XC)dS - JJJ^V-(V XC)dV 

Now taking advantage of the fact that C is a constant vector and that a cy^’hc permutation of 
the elements of a scalar triple product leaves the product unchanged, we cen write 

XV dS = XVdV 

or, removing the constant vector C from each integral, 

c- xvds = c - xvdv 

Since C 18 an arbitrary vector, this equation asserts that the vectors 
XV dS aud XFdV 

have equal projections in all directions and, hence, must be equal to each other, as asserted 

Various important theorems stem from the divergence the¬ 
orem. For instance, if u and v are two sufficiently differentiable 
scalar point functions and if we set 

¥ = uVv 

then, by Eq (13), Sec 12 3, 

V • F = V • (w Vv) = i/V • Vc H- Vu • V?' Vv/ • Vv -j- 

Hence, applying the divergence theorem to t he vector ¥ ~ u Vv, 
we have 

(7) jjjv uV'^v) dV = N • u Vr dS 

Similarly, if we interchange the roles of u and v m (7), we obtain 

(8) f If^, (Vv • Vu + vV^u) dV = 11^ N • r Vu dS 

Finally, if we subtract (8) from (7), we obtain what is known as 

Green’s theorem:* 

THEOREM 2 

If V IS the volume bounded by a closed regular surface S and if u(t,ij,z) and v{x,y,z) 
are scalar functions possessing {‘onlinuous second partial derivatives, then 

///,(uVV-,.VMrfC= /(,N ■ {u Vv — V Vu) dS 

Another result of some importance can be obtained by apply¬ 
ing the divergence theorem to the function F = R/r^ where, as 
Uvsual, 

R = H -f ?yj -h 2 k and r = \¥\ = \/-j- 


This should not be confused with Green's lemma, Theorem 1, Sec 12 4, 
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( 9 ) 


( 10 ) 


Thus, substituting into the divergence theorem, we have 





Now, by Eq. (13), Sec. 12.3, and Exercise 13, Sec. 12.3, 


r, R 1 r, 
V • -. = -j V 
r* r* 


R + R.ri..4 + R.«!/r2v, 

r* r* dr 



3 


R- R 


= 0 


Hence, we conclude from (9) that 



provided, of course, that r is different from zero at all points on 
and within S, that is, provided the origin from which R is drawn 
does not he on S or within the volume enclosed by the surface S 
Since the divergence theorem requires that the function to 
which it is applied have continuous first partial derivatives 
throughout the volume of integration, it cannot be applied to 
R/r* if the origin of R is within S In this case we, therefore, 
modify the region of integration by constructing a sphere S' of 
radius « having the origin 0 as center (Fig 12 25) In the region 


FIGURE 12.25 
A singular point 
excluded from a 
three-dimen¬ 
sional region by 
an auxiliary 
spherical 
boundary. 





V' between and S' the function R/r* satisfies the conditions of 
the divergence theorem, and thus Eq (10) can properly be 
applied, giving 

//s+.-N-5dS = 0 or //,N.?dS+//,,N.5dS = 0 


Now, at any point of S', the direction of the normal which extends 
outward from the volume V' is opposite to R. Hence, the unit 
outer normal to S' is N = — R/e, since on S' the length of the 
radius vector R is r = e. Therefore, in the last integral, 
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and Eq. (11) becomes 



This result, coupled with Eq. (10), gives us Gauss* theorem: 


THEOREM 3 

If 5 18 a closed regular surface, then 




0 outside S 
O inside S 


Another integral formula of great importance in vector 
analysis is Stokes’ theorem:* 


THEOREM 4 

If S is the portion of a regular surface bounded by the closed curve C and if 
F(x,y,z) 18 a vector function possessing continuous first partial derivatives, then 

provided the direction of integration around C is positive with respect to the side 
of S on which the unit normals are drawn 

PROOF To prove this, we suppose first that S has the property that it is 
single-valued above its projections on each of the coordinate planes. Now, if we 
write F = ui -f + wk, Stokes’ theorem becomes 

u dx V dy w dz = N • V x (wi + vj + wk) dS 

(12) = xuidS + ll^V-VxvjdS 

+ //, N ■ V X i«k 

and, to establish it, it is sufficient to show that respective integrals on the two 
sides of the last equation are equal. We consider first the integral 

- V X uidS 

taken over the closed surface consisting of S, its projection on the xy-plane, say 
S\ and the cylindrical surface, say *S", which projects S into S' (Fig. 12 26a) If 
we apply the divergence theorem to the vectoi V x ui over this surface and the 
volume it encloses, we obtain 

fjgV-V xuidS+ ff^,V -V xuidS + N • V x ui dS 

= ///k ^ • (V X ui) dF = 0 
or 

/j^N-VxuidS = - V X uidS - fj^^^V-VXuidS 


Named for the English mathematical physicist G G Stokes (1819-1903). 
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FIGURE 12.26 

The closed surface + iS' + iS" employed in the proof of Stokes' theorem 


since, as we showed in Sec 
tically zero. Now, 

V X ui = 


12 3, the divergence of the curl of any vector is iden- 

i j k 

d d d _ • dw __ d?/ 

dx dy dz I ^ dz dy 

V 0 0 I 


]\foreover, on S' the outer normal N is clearly equal to — k Hence, on S' we have 




If we now apply Green’s lemma (Theorem 1, Sec. 12 4) to the last integral, we find 


jjg,V • V X uidS = - j^,udx 


Furthermore, since S" is a cylindrical surface whose generators are parallel to the 
«-axis, the normals to S" are all perpendicular to the vector k Therefore, on *S" 
we have 

wr V, • wr /■ du , du\ -- . du 

= =N.,- 


where, clearly, N • j is independent of z Then, taking dS = dz ds (Fig 12 26a), 
we have 

ff N-VxwidS- ( -j^dzds 

JJS" Jc' Ji on S* ^ dz 

(15) = l^^[ul-ul)v-}ds 


Now N • j IS equal to the cosine of the angle between the normal N and the posi¬ 
tive j/-axis, and this is numerically equal but opposite in sign to the cosine of the 
angle between the directed tangent to C' and the positive j-axis (Fig. 12.266). 
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Hence, N • j ds = — di, and Eq. (15) becomes 

(16) N • V X ui dS = - u 1^ dx + J^,u |^, dx 

Now, in the first integral on the right in (16), the integrand, being evaluated at 
those points of S which are directly above the curve C\ is actually evaluated 
along the curve C Moreover, because C' is the projection of C in the z-direction, 
the variation of x around C' is exactly the same as the variation of x around C 
Hence, in this integral we can properly replace the indicated path ot integration 
C hy the curve C, getting 

(17) N • V X wi u dx v dx 

Therefore, substituting from (14) and (17) into (13), we have 

jfs N • V X ui ~ ^ ~ ( “ dx -|- w dx^ 

(^8) = ^, u dx 

In precisely the same way we can show' that 

( 19 ) -V XrjdS = p,dy 

(20) /is ^ ^ 

Finally by a ’iirig (18), (19), and' (20) we obtain Eq (12) 

It is now' a simple matter to extend F^q (12) to surfaces S which are not 
single-valued above their projections on the coordinate planes For, if this is not 
the ease, w'e can always subdivide S into regions N, which do have this property 
and then apply Eq (12) to each and its boundary 6\, getting the set of equations 

f^. yy._ N • V X F dS 

When these are added, the surface integrals combine to give precisely the surface 
integral over S itself, since *Si + ■ -h Sn = S At the same time the line 
integrals combine to give the line integral around the actual boundary of S plus 
(he line integral along all the auxiliary boundary arcs taken twice in opposite 
directions (F"ig 12 27) Since the latter cancel identically, the line integral around 
C itself 18 all that remains, and the theorem follows in the general case. 

If A and B are two arbitrary points m space, it is often 
important to know whether the line integral 

(21) 

is independent of the path which joins A and H As a first step in 
establishing criteria for this, we observe that, if the integral (21) 
is independent of the path, then 

/F-dR 

taken around any 'closed path is zero. F^or let C be-any simple 
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HGURE 12.27 
A portion of a 
surface S sub¬ 
divided into 
simpler regions 
Si, S2, . . , Sn 



rloaed curve, and let A and B be any two points on C (Fig. 12 28). 
Then, since the integral is independent of the path, by hypothesi.s, 
we have 

Now, if we reverse the direction of integration in the integral on 
the right, we have 



or, transposing, 

= 0 as asserted 

Conversely, if JF ■ dR is zero around every closed curve in a 
region, then the integral (21) is independent of the path For if 

APB and AQB are any two paths joining A and B (Fig 12 28), 
we have, by hypothesis, 

/.'?),F-dR + i^^F.dR = 0 

whence, by reversing the direction of integration along BQA and 
transposing, 

/^'Fl,F-dR= /^-5^,F.dR as asserted 

Now if the integral (21) is independent of the path, then 
when we integrate from a fixed point Po (xQ,yo,zo) to a variable 


FIGURE 12.28 
Two paths from 
A to ^ forming 
a simple closed 
curve. 



O 
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point P:(x,y,z), the result is a function only of the coordinates 
X, y, z of the variable end point. That is, if F = wi -h yj + wk, 
we can appropriately write 

F ‘ dR = dx V dy w dz = 4>(x,y,z) 

In what follows it will be necessary to know the partial derivatives 
of the function 0 defined by the last equation. To obtain these, it 
18 convenient to jro back to the fundamental definition of a 
derivative and write, for the x-partial derivative, foi instance, 


hm + Ax, y, z) - <t>{x, y,z) 
Ax 


lim 

£iX-*0 


0 ^x4 -At.V,* 
zo,l/o,zo 


u dx V dy w dz 


1'^'^ u dx ■{' V dy w dz] 


Since by hypothesis these integrals arc independent ol the path, 
we can use any paths we find convenient In particular, m the 
integral from (xo,Vo,2o) to (x + Ax, y, z), wc shall let the path of 
integration consist of any smooth curve joining (xo,yo,Zo) to {x,y,z) 
plus the segment of the straight line joining {x,y^z) to (x -f- Ax, y, z) 
(Fig. 12 29) Then, 


FIGURE 12.29 
A convenient 
path of mtcKra- 
tion from 
{zo,yo,Zo) through 
ijr,y,z) to 
(x + Ax, y, z) 


I 



d0 

^x 


lim rr u dx + V dy w dz f ^ u dx v dy w dz\ 

^x—*O^XL\Jxo.vo.^o Jx,V,^ / 

— u dx V dy w dz\ 

yzg.yo.so J 

lim ~ _l_ _j_ ^ 

Ar-rO Jx.v.t 

Now, along the path of integration in the Ifiist integral, we have 
dy ^ 0 and dz ^ 0 

Hence, ^ = hm ^ u dx 

ox Ax—0 Jx 

Since u is assumed to be continuous, the law of the mean for 


integrals can be applied to the last expression, and we have 
lim I 

Ax-^O ^x 


^ = lim ^ [w(x + e Ax, y, z) Ax] 0 < 0 < I 
ax Ax-^o ^x 
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In the same way the partial derivatives with respect to y and a 
can be determined, and we have the following theorem: 


THEOREM 5 

If F = id + yj + U7k is a continuous function of x, y, and z with the property that 


JF • dR = iu dx -\- V dy w dz 

is independent of the path, then the partial derivatives of the function 
^ l^y-dR= u dx + V dy w dz 


are 


dx 




d4> 


= w 


We are now in a position to show that, if F = ui + vy -)- 
18 a continuous vector function and that, if JF • dR is independent 
of the path, then F is the gradient of some scalar function 0 In 
fact, if we define 

F • rfR = u dx V dy w dz 


we have, by Theorem 5, 

V0 = ~ i -h j -f ^ k = ui -h v) + u’k = F 
dx dy-'dz 


as asserted 

Before we can state a correct converse of the last result, we 
must distinguish between two types of regions in space On the 
one hand, a region V may have the property that every simple 
closed curve within it can be continuously contracted into a point 
without at any stage having to leave the region Regions of thus 
type are called simply connected; as examples we have tin* 
interior of a sphere, the exterior of a sphere, and the space bet u ecu 
two concentric spheres On the other hand, a region V may con¬ 
tain simple closed curves which cannot be continuously con¬ 
tracted into a point without at some stage having to leave the 
region. Such regions are called multiply connected; as an example 
we have the space between two infinitely long, coaxial cylinders, 
within which it is clearly impossible to shrink into a single point 
any closed curve encircling the inner cylindrical boundary Both 
the interior and the exterior of a torus are also examples of 
multiply connected regions.* 

Now suppose that, throughout a simply connected region V, 
the vector function F is the gradient of a scalar function 0 Then 

fB fB fB \B 

Ja I V^-dR= I d^= .^ 1 ^ 

and thus the integral of F depends only on the coordinates of the 
end points A and B and not on the path which joins them It is 


• The distinction between simply connected and multiply connected regions 
applies equally well in the plane, of course, and in our study of functions of 
a complex variable it will often be an important consideration 
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easy to show by an example (Exercise 30) that this is not neces¬ 
sarily true for multiply connected regions, since in such cases 0 
need not be continuous and single-valued throughout the region. 

Finally, we observe that, if the curl of F is identically zero 
throughout a simply connected region V, then /F • dR is inde¬ 
pendent of the path, and conversely For, if C is an arbitrary 
closed curve in a simply connected region V, it can be spanned 
by a surface S also lying entirely in V Then, by Stokes’ theorem, 
we have 

^F-rfR = If^N-V xFdS 
and, if V X F = 0, it follows that 
XF.dR = 0 

But, by one of our earlier observations, if JF • dR is zero around 
every closed curve, then it is independent of the path, as asserted 
On the other hand, if jF • dR is independent of the path, then, as 
we showed above, F is the gradient of a certain scalar function 0 
But then V x F = V x V0, and this is identically zero, by Eq. 
(18), Sec 12 3 

The results of the preceding discussion can now be sum¬ 
marized in the following theorem 


THEOREM 6 

If F = ui + vj -|- ick IS a function of x, y, and z possessing continuous first partial 
derivatives at all points of a simply connected region V, then the following state¬ 
ments are all ecjuivalent, that is, any one of them implies each of the others 

a j¥ ’ dR = fu dx A- V dy ^ IV dz is independent of the path 

b JF • r/R = Jw d.r -b dy + w dz is zero around every closed 

curve 

c ¥• dR ^ u dx V dy w dz is an exact differential 
d F IS the gradient of the scalar point function 

0(j:,y,z) = • dR = u dx v dy w dz 

e The curl of F vanishes identically 

EXERCISES 

/■I,1,1 

1 If F = 2yi + ij 4- 2 ®k, evaluate Lqq ^ along 

a The rectilinear path from (0,0,0) to (1,0,0) to (1,1,0) to (1,1,1) 

b The rectilinear path from (0,0,0) to (1,1,0) to (1,1,1) 

c The straight line joining (0,0,0) to (1,1,1) 
d The curve -|- i/’ ” 22 , j = 2 / 

2 If F OS XI 4 yj -I- 2k, evaluate jj^ F • N diS over 

a The surface of the cube whose vertices are (0,0,0), (1,0,0), (1,1,0), (0,1,0), (0,0,1), (1,0,1), 

(l.M), (0,1,1) 

b The portion of the plane ar 4 2i/ -|- 3z — 6 which lies in the first octant 
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T • rfR^ Can Stokes’ theorem be 


10 If A is a constant ’ 


11 If C 18 a closed curve, show that 


12 If C IS a closed curve, show that 


R-dR - 0 


can we conclude that F ^ ()? 


c The entire surface of the sphere x* + y* -H z* — 1 

d The portion of the cone r* + y* — (1 — z)’ * 0 between the planes z - 0 and z - l 

3 If F — yi -|- xj -f 2 *k, evaluate jjjy ^ ^ throughout 

a The volume bounded by the cube whose vertices are (0,0,0), (1,0,0), (1,1,0), (0,1,0), 
(0,0,1), (1,0,1), (1,1,1), (0,1,1) 

b The volume cut off from the first octant by the plane x 2|/ + 3z “ 6 

c The upper half of the volume within the sphere x* -|- y* -f z* " 1 

d The volume under the paraboloid z »= 1 — x* — y* and above the plane z — 0 

4 Write the divergence theorem in cartesian form 
6 Write Green’s theorem in cartesian form 

6 Write Gauss’ theorem in cartesian form 

7 Write Stokes' theorem in cartesian form 

8 If IB a closed surface, what is j■ V X ¥ dS"^ 

9 If T IS the variable unit tangent to a curve T, what is ^ T • dR^ Can Stokes’ theorem be 
used to evaluate this integral^ 

10 If A is a constant vector and T is a closed t urve, show that A * dR ■» 0 Wliat is 

11 If C 18 a closed curve, show that / R ■ dR — 0 

Jc 

12 If C IS a closed curve, show that (u Vv + v Vu) • dR “ 0 

13 If /S 18 a closed surface, show that N • R dS — 3K, where V is the volume enclosed 
by S 

14 If S is an arbitrary closed surface and j’ ¥ dS ™ 0, can we conclude that F ^ 
Can we if S is an arbitrary open surface^ 

16 By applying the divergence theorem to the vector 0A, where A is an arbitrary constent 
vector, show that <^N dS - V4, dV What is N dS'> 

16 By applying Stokes’ theorem to the vector «^A, where A la an arbitrary constant vector, 
show that ^ 0 dR — N X V0 dS 

17 If S 18 an open surface, what is N X R dS^ (Hint Use the result of Exercise IG ) 

18 By applying Stokes’ themrem t-o the vector F X A, where A is an arbitrary constant vector, 
show that dR X F » (N X V) X F dS What is dR X R*^ 

19 Verify the divergence theorem for the function 2xzi + yz) H- z*k over the upper half of the 
sphere x® y* -|- z* *= a*. 

20 Verify the divergence theorem for the function yi + xj -f z*k over the cylindrical region 
bounded by x® + y* — a®, z *» 0, and z = a 

21 Verify the divergence theorem for the function x*i -f zj d- yzk over the rube whose vertices 
are (0,0,0), (1,0,0), (1,1,0), (0,1,0), (0,0,1), (1,0,1), (1,1,1), and (0,1,1) 

32 Verify Stokes’ theorem for the function xyi + yzj + z*k over the cube described in Exercise 
21 if the face of the cube in the xy-plane is missing 
28 What 18 the surface integral of the normal component of the curl of the vector (x + y)i + 
(y — t)} -h 2 *k over the upper half of the sphere x® + y* + z* - 1? 

14 If at each point of a surface S the vector F(x,y,z) is perpendicular to S, prove that the curl 
of F either vanishes identically or is everywhere tangent to S (Hint Apply Btokes’ theorem 
to F over the portion of S bounded by an arbitrary closed curve on S ) 

36 If at each point of a closed surface S the vector F(x,y,z) is perpendicular to 5, prove that 

jjjy ^ X F dV — 0 (Hint’ Use the result of Example 1 ) 


17 If S 1 
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26 If A IS an arbitrary constant vector, show that N X (A X R) dS - 2V"A, where V ib 

the volume bounded by the closed surface S (Hint Use the result of Example 1 ) 


27 Show that 




d<f> 

— dS, where — is the directional deriva- 
dn dn 


Uve of in the direction of the outer normal to the closed surface S which bounds the volume 
V 

28 If <i>(x,y,z) is a solution of Laplace’s equation, show that 


HIM - If. 




where — is the directional derivative t>f 4* in the direction of Lne outer normal to the closed 
dn 

surface Hence show also that f f ^ ^ d*S > 0 if 0 is a solution of Laplace’s equation 

J JS dn 

29 Extend Gauss’ theorem to the case in which O lies on the surface 5 

30 Show that although the function 

-t 2/’ 

IS continuous and equal to the gradient of 

y 

ip(T,y,z) = tan ‘ — z 

X 

at all pomts of the region between the two cylinders 
jz -f yi s 1^ and r* + 2 /* = 4 

the integral /F ■ dR is not independent of the path in this region [Hint Take A to be 

fB 

(— J ,0,0) and li to be (1,0,0), and (oiiipute / F • dR along the upper and lower area of the 
(ircle j:® -b = 1, 2 “ 0 I 


12.6 

Further applications 

One of the moat important uses of vector analysis is in the concise 
formulation of physical laws and the derivation of other results 
fioin those laws As a first example of this sort, we shall develop 
the concept of potential and obtain the partial differential equa¬ 
tion satisfied by the gravitational potential 

To do this, let us suppose that we have a field of force of some 
kind, or, in other words, let us consider a region of space in which 
at every point a force vector F is defined The field might, for 
instance, be gravitational, lu which case ¥(x,y,z) would be the 
force acting on a unit mass at the general point P ix,y,z) because 
of the attraction of other masses present in the region On the 
other hand, the field might be electrostatic, m which case F{x,y,z) 
would be the force acting on a unit charge at the general point 
P .{x,y^z) because of the attraction or repulsion of other charges 
present in the region Or the field might be magnetic, m which 
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case F(x, 2 /, 2 ) would be the force acting on a unit magnetic pole 
situated at the point P {x,y,z). In any case, the force F experienced 
by a unit test body of the appropriate nature is called the field 
intensity. 

Now, the amount of work that must be done when a unit 
test body is moved along an arbitrary curve in the force field 
defined by a vector function F is the line integral of the tangential 
component of F; that is, 


IT = JF • dR 


If there is no dissipation of energy through friction or similar 
effects, then, according to the law of the conservation of energy, 
this integral must be zero around every closed path, and, hence, 
by Theorem 6, See 12 5, it must be independent of the path 
between any given points .1 and P Fields for which this is the 
case arc said to be conservative. Furthermore, according to 
Theorem (1, Sec 12 5, it is clear that in a conservative field the 
force vector F is the gradient of the scalar function 

(t>(x,y,z) = ■ rfR 

The function 0 is called the potential function* of the field In 
most problems, the mavsses or charges which produce F are given, 
and it is required to find F itself Since F = V0, it is clear that 
knowing <t> is equivalent, to knowing F, and, hence, the determimi- 
tion of <f) is of prime importance in most field problems 

Assuming, for definiteness, that we are dealing with a 
gravitational field, let F be the field intensity at a general point 
P (x,y,z), and let AF be the contribution to F due to the infinites¬ 
imal mass Ami m an infinitesimal volume ATi = AjiA?/iAzi 
enclosing the point Pi {ri,yi,Zi) According to Newton’s law of 
universal gravitation, AF is a vector whose magnitude is 

AF = 

ft 

where = (a - XiP 4- (?y — y^Y + (2 - 2 i)“ 

and whose direction is opposite to that of the vector 
R = (r - ji)i -\- (v - yi)i 4- (s' - zi)k 

extending from Pi to P (Fig 12 30) In other words, if units aic 
so chosen that, the constant in Newton's law is equal to unity, the 


* Many writers define the potential to be ^ ' F ■ dR, in which case F = 
— In particular, Po w often taken to he infinitely distant, so that 





FdR 
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FIGURE 12.30 
Figure used in 
calculating the 
potential at a 
point P due to 
the material in a 
volume element 
AFi 

S 

field intensity at P due to the infinitesimal mass Ami at Pi is 

(1) AF = - y = AF, 

where p(xi,i/i,zi) is the density of the material at the point Pi 
Now let S be an arbitrary closed regular surface bounding a 
volume and let / denote the integral over of the normal 
component of the force due to all the attracting material in the 
field. By definition, since F = we have 

(2) / = //, N • F dS = ff^N- dS 

However, I can also be computed by fust determining the part A/ 
of it due to (he material within Abi and then taking all the 
material in the field into account by integration From this point 
of view we have, from (1) and (2), 

A/ = AF dS = - (p(r,,i/„ 2 ,) AF.IN ■ ? dS 

= AK. 

Since ai, yi. Zi are constant with respect to the j,i/,2-inlegration 
over S The la.st integral can, of course, be evaluated by Gauss’ 
theorem (Theorem 3, Sec 12 fi) Specifically, if the origin of R, 
namely, the point Pi is within S, the value of the 

integral is Att, otherwise the value of the integral is 0 Hence, 

— 47rp(Ti,2/i,Zi) AFi AFi within 

0 A7i outsiders 

and, theiefore, in computing / it is necessary to integrate only 
over the volume V bounded by N. Doing this, we find 

/ = j dl = -4ir pix,,yi,Zi) dV, 

or, since xi, y\, zi are just dummy variables, 

/ = -4ir JIJ,, p(.x,y,z) dV 

Equating the two expressions (2) and (3) which we now have 
for 1, we get 

//^N-V^dS = -4x jll^p(x,y,z)dV 






( 3 ) 
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If we now apply the divergence theorem to the integral on the 
left, we have 

fffv^ (^0) dV = -4w p(x,y,z) dV 
or [VV + 4irp{x,y,z)] dV = 0 

Since this holds for any arbitrary volume V, it follows that the 
integrand must vanish identically,* and, therefore, that 

(4) VV = -4tp(i,2/,2) 

This 18 Poisson’s equation, f and we have thus shown that in 
regions occupied by matter^ the gravitational potential satisfies 
Poisson's equation In empty space p(x^y,z) = 0, and thus in 
empty spac^ the gravitational potential satisfies Laplace's equation 

(5) VV = 0 

Results similar to these hold for the electrostatic and magnetic 
potentials. 

As a second example of the use of vector analysis in formulat¬ 
ing physical laws in mathematical terms, we shall now derive 
Maxwell's equationsX for electric and magnetic fields To do this 
we shall have to work with the vector quantities’ 

E = electric intensity 
H = magnetic intensity 
D = eE = electric flux density 
B = pH = magnetic flux density 
J = current density 

and the scalars 

€ = permittivity 
p = permeability 
a = conductivity 
Q = charge density 

q = = total charge within V 

dS = total magnetic flux passing through S 
’-If," • J dS = total cuirent flowing through S 


* Suppose that this is not the case, and let Po he a point at which the inte- 
f^rand does not vanish Then, if p(x,y,z) and VV continuous (as we have 
implicitly assumed), it follows that, throughout some sufficiently small 
three-dimensional region To enclosing Po, the integrand ha.8 everywhere the 
same sign it has at Pn Integrating over To, we then obtain an integral which 
is not equal to zero, contrary to the fact that the integral has been shown 
to be zero for every volume T 

t Named for the French mathematical physicist Simeon Denis Poisson 
(1781-1840) 

1 Named for the English mathematical physicist James Clerk Maxwell 
(1331-1879). 
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These quantities are connected by a number t)f equations expres¬ 
sing relations discovered experimentally in the early years of the 
nineteenth century, chiefly by Michael Faraday (1791-1867). In 
particular we have Faraday’s law, 

which asserts that the integral of the tangential component of the 
electric intensity vector around any closed curve is equal but 
opposite in sign to the rate of change of the magnetic flux passing 
through any surface spanning C, Ampere’s law, 

(7) /pH.rfR = i 

which asserts that the integral of the tangential component of the 
magnetic intensity vector around anv closed curv^' is equal to 
the current flowing through any surface spanning C, Gauss* law 
for electric fields, 

(8) //s N ® = 9 

which asserts that the integral of the normal component of the 
electric flux density over any closed surface *8 is equal to the total 
electric charge enclosed by and Gauss* law for magnetic fields, 

(9) //s N ® = 0 

which asserts that the total magnetic flux 0 passing through a 
closed surface is zero. 

If we now apply Stokes’ theorem to Faraday’s law (6), we 

have 

//,N.vxEffi= 

and, substituting for 0 from its definition in terms of B, 

//,N.rxE*S. - j(/X.N.»Js)- - f/:,«-§dS 

Since *S is an arbitrary surface spanning the arbitrary closed 
curve C, the last equation can hold only if 

(10) V X E = - — 

dt 

Similarly, by applying Stokes’ theorem to Ampere’s law (7), we 
obtain 

//^ N . V X H rfxS = t = //, N . J rfS 

and again, since S is an arbitrary open surface, we conclude that 
the vectors being integrated over S must be identical 


( 11 ) 


V X H = J 
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Now, as Maxwell was the first to realize, the current density 
J consists of two parts, namely, a conduction current density 

]e = erE 

due to the flow of electric charges, and a displacement current 
density 

■*'' ^di ~ ' at 

due to the time variation of the electric field Thus, 

and (11) becomes 

(12) VxH = <tE + €^ 

ot 

Next we apply the divergence theorem to the first of Gauss’ 
laws (8), getting 

III^V.DdV = III^QriV 

whence, since V is arbitrary, 

(13) V-D = 0 

In the same way, by applying the divergence theorem to Gauss’ 
second law (9), we find that 

llf^.V-BdV = 0 

and, therefore, since V is arbitrary, 

(14) V-B - 0 

Now, if we take the curl of Eq (10), we obtain 

vx (VXE) = -VX^ = -|-(V xB) = -,,i(VxH) 

at ot at 

If we expand the term V x (V x E) by means of Eq (20), Sec 
12 3, the last equation becomes 

V(V.E) - V»E = -(x|:(V xH) 
ot 

and, substituting for V x H from (12), 

(15) r(V.E)-r-E. -4(.E + .f) 

Now, if the space charge density Q is zero, as it is to a high degree 
of approximation in both good dielectrics and good conductors, 
then from (13) and the relation D = eE we see that 


V. E = 0 
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Therefore, Eq. (15) reduces to 

V‘E =M.-^ + ^<r- 

which IS Maxwell’s equation for the electric intensity vector E. 

Similarly, if we take the curl of Eq. (12) we obtain 

V X (V X H) = V X ^<rE + t 


and, expanding the left-hand side, 
V(V • H) - vm = X E + eV X 


at 


= crV X E -f € (V X E) 

Of 


Now, substituting for V x E from (10). we have 

But B = /iH, by definition Hence, (14) implies that V • H = 0; 
therefore, the last equation reduces to 


. dH 


which 18 Maxwell’s equation for the magnetic intensity vector H. 

For a perfect dielectric, (t — 0 Hence, in this case Maxwell's 
equations reduce to the three-dimensional wave equations 

V«E = Me and V*H = >*e ^ 

On the other hand, in a good conductor the terms arising from the 
displacement current, i e., the terms containing the second time 
derivatives, are negligible, and Maxwell's equations reduce to 

V^E = m<t and V»H = 

at ot 


which are examples of the three-dimensional heat equation 

As a final application of the methods of vectoi analysis, we 
shall investigate the question of whether or not a solution of the 
heat equation satisfying prescribed boundary and initial condi¬ 
tions over a given region is necessarily unique In our discussion 
of boundary value problems in Chap. 8 we proceeded on the 
assumption that this was the case Nevertheless, examples have 
been given* of solutions of the one-dimensional heat equation 

, du d^u 
a* — = - - 

at dx^ 


* See, for instance, P C Rosenbloom and 1) V Widder, “A Temperature 
Function which Vanishes Identically," Am Math Monthly, vol 65, p. 607, 
October, 1958 
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which possess derivatives of all orders for all values of x and 
satisfy identical initial conditions everywhere on the entire a-axis^ 
and yet are different! Confronted with such a clear-cut failure of 
intuition, we must regard the uniqueness question as of more than 
academic interest and any positive result as having imporianl 
practical significance. 

Let us suppose, then, that wc are to solve the three-dimen¬ 
sional heat equation 

a’* ^ 

ot 

throughout a region V bounded by the closed surface S, subject 
to the boundary condition 

u = f{x,y,z,t) on S 

and the initial condition 

u{x,y,z,0) = g{x,y,z) throughout V 

Furthermore, let us suppose that wc have two solutions of the 
problem, Ui and u^, each of which, with its derivatives through 
the second, is continuous in V 
If we define a new function 

w(x,y,z,t) = \i 2 {x,y,zj) — ui{x,y,z,l) 

it IS clear from the liiicanty of the heat equation that lo also 
satisfies this equation Moreover, obviously assumes boundary 
and initial conditions which are identically zero Finally, w is 
continuous and differentiable, since it is the difference of o 
functions with these properties 

Now consider the volume integral 

J (0 = V 2 jIly w^{x^y,z,t) dV t ^ 0 

Clearly, J{i) is a coiitimious function which is always ecjual to 01 
greater than zero, since its integrand is everywhere nonnegativi' 
Also, since ic = 0 when t = 0, it follows that ./(O) = 0 Now 

and, thus, since wj satisfies the heat equation, we have 

To this, let us apply Kq (7), Sec. 12 fi, with both u and r in the 
formula taken to be the function w of the present problem Then 

jjfy 4- Vw ■ Vw) dV = fl^ N • w Vw dS 

Since the function iv vanishes identically on S, the integral on the 
right side of (18) is zero, and we have 

j^JJ^ wV^w dV = — Vw • Vie dV 
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5M 


(19) 


( 20 ) 


Hence, substituting into (17), 
J'(t) = - A vw • Vw dV 


--?E[(s)’+(fry 

which shows that 
J'{t) ^ 0 for i ^ 0 

Now, by the law of the mean, 

Wir W). rv.) »<,.<, 

or J{t) = .7(0) + tJ'itx) 0 < 

But wc have already verified that 
equation reduces to 


-h 



dV 


U < i 

J{0) = 0. Hence, the last 


J{t) = ir{ty) 


which shows that 
J(i) ^0 for f ^ 0 

since we have just proved that J\i) is nonpositive for i ^ 0 How¬ 
ever, as we observed earlier, the definition of J{t) shows that 

J{t) ^0 for / ^ 0 


The only way in which the inecpialities (19) and (20) can simul¬ 
taneously be fulfilled is for J{t) to be identically zero. But this is 
possible if and only if the integrand of J{t) vanishes identically 
Hence, 


tv(x,y,z,i) he 'U2{x,y,z,t) - Ui(x,y,z,t) = 0 
or U2(T,y,z,t) = 7 ii(x,y,z,t) 


Thus 7 77 hounded regions, Iwiee dijferentiable solutions of the heat 
equation satisfying prescribed surface and initial temperature con¬ 
ditions are unique 


EXERCISES 

1 What iH the potential function for a (enfral force field in which the attraction on a particle 
vanes directly as the square of the distance fron the origin? inversely as the distance from 
the origin'!’ 

2 What is the potential function of the force field due to uniform rotation about the z-axis? 

3 What 18 the potential function for the gravitational field of a uniform circular disk at any 
point on the axis of the disk? 

6 What is the potential function for the gravitational field of a uniform sphere of radius a 
and mass M? Show tliat the attraction of the sphere at a point P a distance r from the center 
of the sphere is 



r ^ a 
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6 

7 

8 


9 


10 


Show that the electrostatic field intensity at a point P due to a set of charges qx is equal to 


n 



where R, is the vector from the point P to the point Px where the charge g, is located 
Verify that V • E -» 0 in this case 

Show that the work done in bringing a charge of strength q from infimty to a point at a 
distance of ro from a fixed charge qo is qqo/ro Using this result, determine the total energy 
in the electrostatic field defined by the fixed charges qi, qi, . , qn whose mutual distances 


are Tx, 

If a conductor is defined to be a body in whose interior the electric field is everywhere zero, 
show that any charge on a conductor must be located entirely on its surface. 

Let V\ and V 2 be two regions with respective dielectric constants n and <a, and let S be the 
surface of discontinuity which separates them By applying Uiauss' law for electric fields 
to a closed cylindrical surface of infinitesimal height whose bases are parallel to S in 
the respective media, show that, if there are no charges on the normal component of the 
electric flux density is continuous across S Similarly, by applying Faraday’s law to a 
rectangle of negligible width whose longer sides are parallel to S in the respective media, 
prove that, if the field is conservative, the tangential com|M)nent of the electric iiitensil\ ih 
continuous across S 


What IS the electric field in the empty .space between the perfedly conducting, infinitf' 

I dE I . 

planes y * 0 and v “ / d E = 1 f k and — = i — k^ (Hint hroin the nature c»t 

li = o dt l< = o 


the region of the problem and the initial conditions, it is clear that the field has no component 
in the 7/-direction and that Ei and E, are functions only of q ) 

Prove that a solution of thp heat eiiuation, po'^MCssing continuous second partial derivatives, 
which takes on prescribed initial values throughout a region V and who.se normal denvativf 
takes on prescribed values on the surface S which encloses V is unique 


CHAPTER THIRTEEN 


Tensor Analysis 


13.1 

Introduction In Chap 10 wo introduced the concept of a vector as either a 
(l,n) or an (n,l) matrix, thnt is, as an ordered set of n quantities. 
In the last chapter we took a somewhat less absf ract pomt of view 
and rej^arded a vector as a quantity which could be represented 
by a directed line segment Using this interpretation wc then 
developed the algebra and calculus of vectors In doing this, we 
worked implicitly (and sometimes explicitly) in a rectangular 
frame of reference, nonetheless, it should be clear that we were 
dealing with (}uantitievS independent of any partn ular coordinate 
system For example, though the description of a point, that is, its 
coordinates, may change from one coordinate system to another, 
the point is recognizably the same in all coordinate systems. 
Similarly, although the formula by which it is computed may 
change, the length of a particular vector musir be the same in all 
coordinate systems. 

In this chapter we shall pursue further this idea of invariance 
and adopt as our fundamental idea of a vector the concept of a 
quantity invariant under any transformation of coordinates This 
will lead us to the idea of the covariant and contravanant repre¬ 
sentation of vectors and, thence, to the highly important concept 
of a tensor Although we cannot undertake a detailed discussion 
of tensor analysis, we shall undertake to indicate some of its 
principal features and illustrate the remarkable economy of the 
tensor notation 


13.2 

Oblique coordinates 

Because of the need to distinguish between what we shall soon 
refer to as covariant and contravariant vectors^ it is necessary that 
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a) 

( 2 ) 


our notation employ indices not only in the familiar subscript 
position but in the superscript position as well. In tensor analysis 
this requirement takes precedence over the usual exponential 
symbolism, and, henceforth, when we write, say, 


a will be a distinguishing index, like subscripts heretofore, and 
not an exponent If and when we wish to indicate the ath power 
of a quantity ^ we shall always use parentheses and write 

With this convention in mind, and as a relatively simple 
example of the generalized coordinates we shall subsequently in¬ 
vestigate, let us consider a system of coordinates con¬ 

nected with a system of rectangular coordinates {x^,x^,x^) by the 
equations 


X^ = aiii* 

-h anx^ 

4- aux^ 


ttll 

ai2 

an 

"h 

II 

+ azzx^ 

4- a23X^ 

1-41 = 


a22 

a23 

X^ = aaiJ^ 

4- 

+ aux^ 


O'.Tl 

^32 

a33 


or, in matric form, 

X = AX 

and 

X = A-'X 


where, as usual, 



A’t 




The locus of points for which .r^ = 0 is, of course, the plane 


TTi' aux^ 4- = 0 


Similarly, the locus of points for which = 0 is the plane 
TTz azir^ + 022 x ‘^ + azax** = 0 

and the locus of points for which = 0 is t he plane 
a^ix^ + -j- UasJ’’’ = 0 

Clearly, on the line of intersection of ttz and tts, both x^ and X* are 
zero and x^ alone varies This line can, therefore, be thought of as 
the X^-axi8 In the same fashion we can identify the line of inter¬ 
section of TTi and TTa as the X^-axis, and the line of niterseclion of 
TTi and TTz as the X^-axis (Fig 13.1a). Since the point for which 
X* = = X* = 0 obviously lies in tti, ttz, and tts, it follows that 


t Not only the new coordinates themselves?, but all quantities referred to 
the new coordinate system we shall consistently denote by overbars Thus, 
if P 18 the name of a point described in the original (rectangular) coordinate 
system by the coordinates (pbp*,p’), then P is the name we shall use for this 

E ioint thought of as described oy the new coordinates (p’.p’.p") determined 

y Eq (1) 


SEC. 13.2 


OUIQUI COORDINATES 


5f7 



FIGURE 13 1 

A rcctanpillar and an oblique coordinate Hysiein with their related reference veetons 


the f^-, x^-axes are conrurreiit Moreover, since |.4| 9^0, 
these lines arc distinct and noncoplanar. In fijeneral, however, they 
will not ho iniitiially perpcridioular, and for this reason they are 
said to be the axes of an oblique coordinate system. 

Since (he x^-, J*-, and Jr^-axes are noncoplanar, any vector 
can be expressed as a linear combination of arbitrary reference 
vectors alonp; the throe oblnpio axes Hv analoj^y with the unit 
vectors i, j, k, or ei, 62, ea, as wo shall now denote them, it might 
seem natural to choose vectors of unit length for this purpose. 
However, because the oblique coordinates P, x* are not 
distance measures along tlio oblupio axes, as xh x'* are along 
the axes of a rectangular coordinate system, it turns out to be 
more convenient to take the new leteronee vectors 61 , 62 , S 3 to be, 
respectively, the vectors from the origin to the points whose 
oblique coordinates are (1,0,0), (0,1,0), and (0,0,1) (Fig 13 lb) 

To determine the lengths of the reference veetois 61 , 62 , S 3 
and to obtain the formula for measuring distances in general in 
oblique coordinates, let us consider the vector extending from 

pi 

the point P whose matrix of oblique coordinates is r = to the 

p3 

point Q whose matrix of oblique coordinates is Vq = From 

Eq. ( 2 ) it follows that the rectangular coordinates of P (= P) and 

t In this chapter we shall use boldface symbols to denote vectors only when 
we are considering them as directed line segments, as we did in the last 
chapter In particular,jf V is a vector considered in the geometric sense, we 
shall use the symbol V to denote not the length of V but rather the matrix 
of the components of V along the appropriate set of axes. 



5^ 


TiNSOt ANALYSIS 


CHAP. ]3 


0 (= Q) are defined, respectively, by the matrices 
Vp = A-'Vp and Vq = A-^?q 

Hence, in rectangular coordinates, the vector V = — Vp 

(Fig 13.2a), defined by the matrix of components V = V'q — Vp, 



A vector V represented in each nf two cooidinate syeteinb 


becomes the vector W Yq — Vr (Fig. 13 2h) defined by (ho 
matrix 

V = Vq - Vp = A-^Vq - A-^Vp = A-^i?Q - Vp) =A-^V 

Now, m rectangular coordinates, the square of the length of a 
vector V whose matrix of components is V is given by the formula 

V . V = V^IV = V^VV 

where, for later convenience, we have introduced G as another 
name for the matrix which is / in this case but not m general 
Therefore, since we require the length of a given vector to be the 
same in all coordinate systems, we define the scalar product of a 
vector with itself m oblique coordinates by the condition that 

9-V = V-V = (A-^V)’^I{A-^V) = V^{A-^)'^JA-^V 

= V'^[{A-^)^A-^]V 

(3) = V^GV 
Similarly, for distinct vectors IT and V, we define 

tJ . V = U • V = (A-^ll)^I(A-W) = ir{A-^)^IA-^V 

= U^[(A-^)'^A-^]V 

( 4 ) = O^OV 

Thus, the metrical properties of space, which tn rectangular coor¬ 
dinates are determined by the identity matrix I = G, are in oblique 
coordinates determined by the matrix = G^ where A is the 


see, 13.S 


OHIQUI COOROINATIS 


(5) 


( 6 ) 


matrix of the transformation = AX from rectangular to oblique 
coordinates. 

Denoting by the element in the tth row and ^th column of 
the matrix G = it is clear from Eqs (3) and (4) that, 

for the reference vectors €i, £| defined by the matrices 


= 

1 

0 

it = 

0 

1 

es = 

0| 

ft»ft, 

0 

1 

9„ 

0 


ll 


In particular, the lengths of fti, 6 j, and 63 are, respectively, 

l*i| = y/Jii 1^*1 = \/^» 1**1 * v'^83 

In other words, the length of ts such that, if ft is the vector extending 
along the x^-axis from the origin to the point for which £* = d*, then 
the relation |ft| = |<!’; |fe,| holds 

In a rectangular coordinate system a unique set of directions 
for the reference vectors is clearly identified by the axes of the 
system. In oblique coordinates this is not the case; for, although 
the oblique axes certainly define a set of directions in which 
reference vectors can naturally be chosen, there is another set 
distinct from the first which is also intrinsic in the system, namely, 
the directions perpendicular to the coordinate planes tti, n, 

As base vectors in these directions it is (‘ustomary to take vectors 
ft® defined by the conditions 


For i 9 ^ j these relations fix the directions of the new reference 
vectors, and for i = j they determine their lengths and sense. 
The vectors ft‘, ft^ ft® are said to form a set reciprocal to the set 
61 , 62 , ^ 3 , and vice versa* (Fig 13 3) IVoni their definition it is 


FIGURE 13 3 

The base voctors 
fii, 62 , ftj and the 
reciprocal base 
vectors #*, 6 *, 6 * 
in an oblique 
coordinate 
system. 



• It 18 evident that in rectangular coordinatea the set of base vectors and the 
set of reciprocal vectors are the same, that is, 1 » ei ■■ e*, j » 02 “ «*» 
k s ei — e* It 18 for this reason that the concept of reciprocal sets of vec¬ 
tors was not introduced in the last chapter (except in Exercise 23, Sec. 12.1). 
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clear that 6 ^, 6 ^, 6 * are noncoplanar and, hence, can be used a 8 a 
basis for the representation of any vector. Thus, when we use 
oblique coordinates, any vector V has two different but equally 
natural representations. It can be expressed as a linear combina¬ 
tion of the base vectors fei, 62 , 6 a, or it can be expressed as a linear 
combination of the vectors of the reciprocal set 6 *, 

In particular, the vectors in each of the sets 61 , 62 , 6 ^ and 
6 \ 6 ^, 6 ^ must be expressible as linear combinations of the vectors 
in the other set Specifically, if we write 

61 = Mii6^ + ^126^ + M136® 

62 = M2i 6^ “h ^*226^ + /i 236 ® 

63 = + M326* + /^336® 

and then form the scalar product of each side of the ith equation 
with 6 j, we obtain 

fix • 6 j = M.i6^ * 6 j -H M. 26 ^ • fij -r Mia 6 ^ • 6 ; 

Hence, using Eqs (5) and ( 6 ), we find 

= Mtj 

and, therefore, 

61 = ^iifi^ + ^ 126 * + ^K^fi^ 

62 = ^2ifi^ + ^226^ + ^236^ 
fia = -b ^ 326 ^ + gsafi® 

If we define the matrices 

fii fi' 

F, = 62 and F* = fi’* 

63 fi' 

Eq (7) can be written more compactly in the form 

F, = (?F- 

from which it follows that 

F- = (5-»F, 

or 

6' = 5"fil + ^'='fi2 + 5^*fi3 
6 * == ^^'61 -h ^”fi 2 + ^'=*63 

where is the element m Ihe ith row and jth column of G~^\ 
that is, 
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Of course, since G — is symmetric, so is its 

inverse = AA"^ From (10) and (6) it follows im¬ 

mediately that 

6‘. 6^ = 

Thus, in oblique coordinates the metrical properties of space, which 
arc determined by the matrix G = if vectors are 

represented in terms of the base vectors 6 i, § 2 , Sa are determined 
equally well by the inverse matrix G~^ = ||^‘^|! = AA’^ if vectors are 
1 epresenied in terms of the reciprocal base vectors 6^, 6*. 

It IS also instructive to consider \he representation of the vec¬ 
tors i = Cl = e\j = 62 = e^, k = 63 = in terms of the vectors 
€ 1 , 62 , and 6 ^, 6 ^, and vice versa, Specifically, since € 1 , 62 , 
are, respectively, the vectors fioin the origin 0 {= 0) to the points 
whose oblique cooidinates are ( 1 , 0 , 0 ), ( 0 , 1 , 0 ), and ( 0 , 0 , 1 ) and 
since, from the transiormation eiiuation X = these points 

have rectangular coordinates (a^*,a*^,a®*), and 

(a*^,a^^,a®’), where a'^ .'Ij./l/lj is the clement in the ith row and 
jth column of the matrix >4“*, it follows that 

= a^^ei + + a*>e3 

62 = a^^Bi tt”e2 + a^^Bi 

€3 = a^^Bi -h a’^^B>2 T- a”e3 
or, introducing the matrices 


Si 


i 


©1 



62 

and Fe = 

j 

= 

©2 

= 


63 


k 


©8 


e® 


V, = {A-^We = (A'^)-^Ve 

Either in the same fashion or directly from (13), we obtain 
F. = A^Vc 
that is, 

©1 = “h 021^2 4" 

©2 = ai 2 ©l “h 022^2 4" <232^3 
©j = 4“ ^2362 + Oaafia 

as the equations expressing i = Ci, j = C 2 , k = ea m terms of the 
base vectors 61 , § 2 , 63 of the oblique system. 

To obtain the equations relating ft*, 6 * and i = e*, j - ©*, 
k = e^, we begin wuth the relation (9), i e , From 

this, using (13) and the fact that G~^ = AA'^ and F, = V*, we 
have 
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that is, 

= oiic^ + oije^ -h ttiac* 

(17) 6* *= djiC^ "1“ 022©* “H tl2aC* 

6* = asie^ + 032©* + 033©* 

Solving (16) for V% we have, of course, 

(18) 7- = 


or 


(19) 


( 20 ) 


( 21 ) 


( 22 ) 


e' = 4- 

e? = fl21gl _|_ fl22g2 ^2358 

e« = + a»»6* 

Suppose now that we have a vector 

V == V" = ui + rj + = v^ei + 7’^e2 + = ei©' + + ca©* = Vr 

where, since V is given in a rectangular coordinate system, e, " e' 
and V’’ = Vr If we express V = V'’ in terms of the base vectors 
€i, 62, €3 of the oblique system by means of (15), we obtain, after 
collecting terms, 

= (v^aii + v^ai2 -{“ e*ai3)Si -{- (e*a2) 4" ^^022 + c*a20^2 

+ (r^Oai + r*a32 + i;®a33)S3 

= 0^61 4- t )*62 4- ^ 5*63 

Similarly, if we express V = Vr m terms of the reciprocal base 
vectors 6^ 6* by means of (19), we obtain the representation 

Vr = (via^^ 4- ^20^* + i;30®‘)fe* -f (fqo^* 4- 

+ (vio'® -b ?^2a®* + 

= -b 1)2^^ + Vsfi* 

Thus, when V is transformed from its representation in terms 
of the base vectors Ci, e2, ©3 to the corresponding representation 
in terms of the base vectors 61, 62, €3, the components of V = V*" 
transform according to the law 

0* = Gxiv^ 4- a,2r* + a,3i;* 


or 

(23) ^ AV^ 

Likewise, when V s Vr is transformed from its representation in 
terms of the base vectors e^ e* to its corresponding representa¬ 
tion m terms of the reciprocal base vectors 6 b 6^ 6", its components 
transform according to the law 

(24) f\ = a^'vi 4" o>'^'V2 “b a**t^3 


or 

fr - (A-^yVr 


( 25 ) 
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Equations (24) and (25) have exactly the same form as Eqs. (12) 
and (13) for the transformation of the base vectors ei, ea, e*; for 
this reason, the representation of V in terms of the reciprocal base 
vectors is called the covariant representation* of V. On the other 
hand, Eqs (22) and (23) have the form of Eqs. (16) and (17) for 
the transformation of the reciprocal base vectors e\ e*, e*, for 
this reason, the representation of V in terms of the base vectors 
themselves is called the contravariant representationf of V. 

From Eq (1) it is clear that 

dx' 

dx^ 

and from Eq (2) it is clear that 
dx' 


There is no particular reason for introducing this notation in the 
study of oblique coordinates, l>ut it may be helpful as a prepara¬ 
tion for the work of the next, section on generalized coordinates to 
rewrite some of the important formulas of this section m terms of 
the partial derivatives of the transformation equations 

For the matrix of the transformation and its inverse wc have, 
respect.ively, 


ax' 1 

and 

A-' = ||o''|| = ^ 

dx’ 1 


" " djt^ 


For the general cleinent'of the matrix G = which 

in oblique coordinates defines the metrical properties of space, we 
have 


g., = J J g 


dx^ dx^ 
dx' dx^ 


or, inserting the factor gki which of course is 1 if fc = ^ and 0 if 
k ^ I, 

§•1 = ) 9ti 


Likewise, for the matrix G ' 
, V V dx* dx^ 

g‘’ = 2, = I 5x“* a“xi 


we have 


or, inserting = Qki, 

" dx” ax' 


• Co- -> wUh or alike 
t Contra- « against or opposite to. 
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( 28 ) 

( 29 ) 

( 30 ) 

( 31 ) 

( 32 ) 

( 33 ) 


For the relations connecting the base vectors 4i, 4j, 63 and 
the vectors Oi, ei, 63, we have from (12) and (15), 

k A 

and 

e* = 2»..6. =26.0 

1 ■ 

For the relations connecting the reciprocal base vectors 
6^ 6^, 6^ and the vectors we have from (17) and (U/i, 




and 

1 1 

For the components of a vector represented covariantly, 
we have from the law of transformation (24), 

5. = = 

k k 

For the components of a vector represented contravariiintly, 
we have from the law of transfoimation (22), 

k k 

If we have a general transformation of coordinates, say 
X' = x‘(x\x\.t’) 1 = 1, 2, 3 


then any vector whose components transform according to the law 
(32) is called a covariant vector, and any vector whose compo¬ 
nents transform according to the law (33) is called a contra- 
variant vector. In rectangular coordinates, as we pointed out 
earlier, the base set ei, 62, 63 and the reciprocal set e\ e^, are 
identical Hence, there is no distinction between covanant and 
contravariant vectors, and no need to introduce the two concepts, 
in elementary vector analysis 


EXERCISES 

1 Prove that, for any nonsingular matrix the product G ■= is symmetric 

2 What 18 the condition tliat the set of base vectors fti, fcz, S* and the set of reciprocal vectorH 

6*, fi" be the same? 

8 a Let xb x*, i* and f‘, £*, f * be, respectively, rectangular and oblique coordinates connected 
by the transformation equations 

S' - 2x' -h i» 

- x» -b 2x> -b 3x» 
f* - + x> + x« 
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Working directly from their definitions, determine the rectangular representation of the 
base vectors 6 i, 62 , 63 and the reciprocal vectors ft’, ft®, ft* Thence verify that Eqs (12) and 
(17) are satisfied 

b Work part a if the matrix of the transformation to oblique coordinates is 


4 


11 

2 

-1 

1 ^ 

1 

3 

1 1 

1 

1 


4 a In Exercise 3a, v hat is the distance from the origin to the point whose oblique coordinatiia 
are (1,1,1)^ What is the distance between the points whose oblique cooiJiuates are (1,1,1) 
and (1,2,3)'^ 

b In Exercise 3b what is the distance from the origin In tlip points W'hose oblique coor¬ 
dinates are (1,0,— 1) and (2,1,1)'^ 

6 a II U and V are two vectors repiesented eontravariantly in an oblique cooidinate system 
connected with a rectangulai coonliiniti' svsleni b>'^ the iranslormation X = AX, show that 
tlie angle between U and V is given by the formula 

0^G\ 

cos 0 -- -— 

v x/V^OV 


b What IS the angle between two vectors tj ami V represented covananlly? 


13.3 

Generaliz^'d coordinates 

Let .r‘, .r* be three independent, single-valued, differentiable 

scalar point functions such that to every point of some region 
R of three-dimensional euclidean space there coiresponds a 
unique triple of values (a:’,x^,j:^), and such that to every triple 
of values within ranges determined by the nature of R 

there corresjionds a unique point of R. Then x\ are called 

generalized coordinates in R, and the coirespondence between 
the points ol R and the numbei triples is called a 

generalized coordinate system for R Rectangular, cylindrical, 
spherical, and now oblique coordinates are familiar examples of 
generalized coordinates 

Through each point F of R there passes a unique surface 
on which is constant, a unique surface on which x^ is con¬ 
stant, and a unique surface on which x* is constant These sur¬ 
faces intersect by pairs in curves, called parametric curves, which 
pass througli F and on which one and only one of the generalized 
coordinates vanes Under the assumptions we have made about 
x\ x^, it can be shown that at each point of R the tangents to 
the parametric* curves which pass through that point aie non- 
coplanar In general, the tangents to the parametric curves will 
vary in direction from point to point, and no one set of directions 
18 singled out as any more natural than any other for the directions 
of a set of base vectors for R However, al each point, vectors along 
the tangents to tjie parametric curves through that point provide 
a natural basis for the representation of vectors extending from 
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NGURE 13.4 
The parametric 
curves and the 
local base vectors 
at a point P m a 
generalized 
coordinate 
system 



that point as origin (Fig. 13.4), and our development will be based 
on this concept of local base vectors and, of course, the related 
concept of local reciprocal base vectors 

The local base vectors ei, ej, Ca at any point P we define to 
have, respectively, the directions of the tangents to the x^-, x^-, 
x*-parametric curves at F, and to have lengths |e,| = \/e, • e„ 
such that, if ds is the mhnitesimal distance along the j‘-parametric 
curve corresponding to the infinitesimal change dx* in x*, then 

(1) ds = |e. dx'\ = -\/e. • Ct |dx*| 


At P we define the local reciprocal base vectors e^ e*, e* precisely 
as we did in oblique coordinates, namely, by the conditions 



where, as usual, e" • e, = |e"| le^l cos (e‘,ej). 

Since our definitions for the local base vectors and the cor¬ 
responding reciprocal vectors involve the notion of length, we 
must, of course, have some method of measuring distances To do 
this, we assume the existence throughout P of a positive-definite 
matrix 




whose elements are functions of the generalized coordinates and 
which has the property that, if 


dX 


dx^ 

dx* 

dx> 


then the distance ds from P . (x^x®,x*) to Q- (x^ + dx^, x* + dx*, 
X* + dx*) is given by the formula 

(dsY = {dXYGidX) - 2 g., dx* dx> 


( 2 ) 
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(3) 

(4) 


(5) 


( 6 ) 

( 7 ) 


Thus, if = x'(t), x^ = = ^*(0 are the parametric 

equations of a curve, then the length of the curve between the 
points Pi and Pa at which t has the values li and /a, respectively, 
is 


fp' = P VJ ^ ^ 

*.} 

In particular, for the length of an arbitrary inf..iitesimal vector 


dx' dx^ 


ei dx^ + 62 dx"^ -h Ca dx" 


we have 


ids)^ = (ei dx‘ H- dx^ + ea dx^) • (ei dx^ + Ca dx* + 63 dx®) 

= ^ e, ■ Cj dx* dx^ - ^ g,j dx'd / ^ 

tj ».j 

Since the differentials of tlie coordinates are independent and 
arbitrary, the coeffn lents of corresponding terms in the last two 
sums must be identical, thoreiore, 


61 ■ Cj — Qij 

In particular, 

|e*l = V®‘ • 

Using (3) and (4), we can determine without integration the 
length of a noninfinitesimal vector V — r’Ci + ?’^e2 + r^es ex¬ 
pressed in terms of the base vectors at a point P. In fact, 

|V12 = V • V = (r^ei + -h • (r'e, + + v^e^) 

= 2 e. ■ = I = V^GV 

hJ 

Hence, 

|vi = 

where, of course, the elements g,j of G are to be evaluated at the 
point P at which ei, Cz, 63 are the base vectors. 

From (3) we also draw’ the important conclusion that a neces¬ 
sary and sufficient condition that the parametric curves he orthogonal 
at every point of R is that g^j = 0 for i j at all points of R 

By exactly the same reasoning we used to derive Eqs (7) 
and (10) in the last section we can now prove that, for the local 
base vectors and the local reciprocal base vectors, we have the 
following relations 

e. = J ?.*e* 

k 

e‘ = X S’*®* 

h 

where, as in the last section, is the element in the ith row and 
A-th column of the matrix G~^ which is the inverse of G = PC'**!!- 
Furthermore, by forming the scalar product of Eq (7) with 
and using the definitive relation • e* = where 6*^ is the 


608 


TINSOR ANALYSIS 


CHAP. 13 


( 8 ) 


(9) 


( 10 ) 


( 11 ) 


( 12 ) 


Kronecker delta,* we obtain the following companion result to 
Eq. (3)- 

e' • 

Equation (7) is not the only formula which can be used to 
express the local reciprocal vectors in terms of the local base 
vectors Specifically, it is easy to verify that e\ e*, e* are given in 
terms of ei, € 2 , Ca by the formulas 

el = ^2 X ga ^ ea X Cl ^3 ^ 61 X 62 

[© 16263 ] [ 616263 ] ® [ 616263 ] 

Hence, using the result of Exercise 22 , Sec. 12 , 1 , 

[eie2e*| = ^ x = [©16 263]^ 

[© 16263 ] [ 6 , 0263 ] ^ [ 616263 ] [ 616263 ]* 

•= 1 

[ 616263 ] 

Moreover, using Eq (fi) in conjunction with Eq (10), the numeri¬ 
cal value of [ 616263 ] (and hence of [e^e^e®]) can easily be found. 
For, by ( 6 ), 

[e,e^,l = sf„e') • x (J guc*) 

» 3 k 

i,J,k 

Now, of the 3* = 27 terms which arise as i, j, and k range inde¬ 
pendently over the numbers 1 , 2 , 3 , t wenty-one are zero, because 
the scalar triple product [e'e^e^] contains at least one repeated 
factor Of the remaining six terms in the last sum there are three, 
corresponding to the sets of values = (1,2,3), (2,3,1),(3,1,2), 

in which 


[e‘e^e*] = [e^e^e®] = r~ 

[ 616263 ] 


In the remaining three terms, corresponding to the sets of values 
(^Jj^) = (1.3»2), (3,2,1), (2,1,3), the factor [e’e^e*] is equal to 
1 


- 6^e*e» = - 


6 , 6263 ] 


Hence, factoring l/[eie 2 e 3 ] from the sum in ( 11 ) and cross- 
multiplying, we have 


[616268]* — ^Ilf722^a8 ■+■ ^7l2^723^73I 4" ^18^21^82 


” gwgizQu — QnQiigzx — giiQiiQu 

Since the sum on the right in the last equation is precisely the 
expansion of the determinant of the matrix G = l|gt,||, we have 
thus established the useful result 

[ 616263 ]* = \G\ 


Defined at the end of Sec. 10.1 
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where G is the matrix which defines the metrical properties of 
space. 

We now turn our attention to transformations from one set of 
generalized coordinates to another. In particular, we are interested 
in the laws of transformation for the fundamental matr/'-es G and 
the local base vectors ei, e^, es, the local reciprocal vectors 
e^, e®, e®, and vectors expressed in terms of these reference vectors, 
which are induced by a transformation of coord], ates. 

Let us suppose, then, that we have two systcr s of cooidinates 
and connected by transformation equations of 

the form 
x} = 

X* = 5*(x\.t2,x®) 

X* = x*(a:Sx^x’) 
or, simply, 

(13) T r = 1 = 1, 2, 3 

In particular cases, the equations (13) might be the equations 
connecting a rectangular and an oblique coordinate system, os in 
the last section, a rectangular and a cylindrical coordinate system; 
a rectangular and a spherical coordinate system, or a cylindrical 
and a spherical coordinate system 

Naturally, we wish a point with coordinates (x^r^jX®) in the 
x-system to have a unique set of coordinates (x^x*,i”) in the 
x-systern Hence we require that, throughout the region R with 
which we aie concerned, the x''8 be single-valued functions of the 
x‘'s. Moreover, we wish the point with coordinates (x^£^,f®) to 
have a unique set of x-coordinates. Hence, we also require that 
Eqs. (13) be solvable for x^ x^ x^ as single-valued functions of 
x^ x^ x\ say 

(14) T-i x« = x'(i^x^x*) i = 1, 2, 3 

In advanced calculus it is shown* that, if the first partial 
derivatives of the coordinate functions in T are continuous 
and if, throughout Rj the so-called Jacobian determinant 

dx^ dx} dx^ 
dx^ dx* dx" 

t ^ ^ 

dx^ dx* d.T® 
dj* dx" 

dx^ ^* 


(15) 


|/| = 


d(xSx*,x") 

d(x\x*,x") 


* See, for instance, R C. Buck, "Advanced Calculus," p 215, McGraw-Hill 
Book Company. New York, 1956, 

t Named lor tne German mathematician C G J Jacobi (1804-1851) 
We shall frequently refer to the Jacobian matrix J simply as the Jacobian 
of the transformation T 
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(16) 


18 different from zero, as we shall suppose^ then around any 
interior point of R there exists a neighborhood in which T has a 
a single-valued inverse (14) Naturally, since the equations of the 
inverse transformation (14) are to be uniquely solvable for 
X*, the Jacobian determinant of the inverse transformation 


\J\ = 




dx^ 

dx^ 

Ax' 

'df} 

dx® 


dx^ 

dx2 


dx^ 

dx^ 


dx» 

dx» 

dx’ 

dx^ 

dx* 

dx* 


must also be different from zero throughout R. 

We have now reached the point where it is convenient, or 
indeed necessary, to introduce the so-called Einstein summation 
convention. Just as the summation symbol 2 effects a great 
notational economy when it is used instead of writing a sum of 
terms at length, so this summation convention replaces the symbol 
2 with a notation still shorter and much more suggestive. Briefly, 
the convention is this* // any term contains the same letter twice as a 
distinguishing index ^ it is understood that the term^ is to be summed for 
all values of the repeated index For example, using the summation 
convention, with the understanding that the range of our indices 
is 1 to 3, we can write ihe differenlial of m the equivalent forms 

3 


dx' = —-j dx^ + ' dz^ H- - dx^ ~ 

dx^ dx^ dx^ U dx^ 


dx^ 


In the last expression, the index i identifies the particular variable 
r' whose differential is being considered, and cannot be changed 
On the other hand, the index j merely indicates that summation 
over a certain range is to be carried out, and, like the variable 
of integration in a definite integral, can be changed at pleasure to 
any other letter except i, of course. Thus we can write equally well 


di’ j dx^ j . df'^ j 

oi' = — dx^ = —. dx'^ — -ax® = 

dx^ dx* dx® 


An index which can thus be arbitrarily replaced by another is 
usually called a dummy index or an umbral index. 

The summation convention also permits more than one pair 
of repeated indices in a term to be summed For instance, applying 
the convention first to the repeated index i and then toj, we have 

dx‘ dx^ = Q\j dx^ dx^ -|- g2] dx^ dx^ -h dx^ dx^ 

— igii dx^ dx^ + gi 2 dx^ dx^ -f g^ dx^ dx^) 

+ (^21 dx^ dx* -f g22 dx^ dx^ -h gfja dx^ dx^) 

+ (^81 dx* dx^ H- ^32 dx* dx* -(- gn dx* dx®) 

= J g,j dx* dz^ 
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It should be noted that 
Qtj dx* dx^ ^ p,, dx* dx* 

since the latter is equal to the simpler sum 
Qw dx^ dx^ -f gjj dx* dx* -h dx* dx* 

Hence, unless the more restricted meaning is intended, the same 
index cannot be used a second time in the same te. m as a dummy 
index. 

Preparatory to resuming our discussion of coordinate trans¬ 
formations, it will be helpful to introduce several simple lemmas 
at this point. 


LEMMA 1 

If (x’,x*,x*) and (f^,x*,x*) are coordinates connected by a transformation 


then 


x‘ = i'(x\x*,.T^) 
dx^ ~ 


PROOF By hypothesis, x' is a differentiable function of x\ x*, x*, which in turn 
arc differentiable functions of x\ x*, x® Hence, by the chain rule of partial 
differentiation. 


dx* _ , dx* dx^ dx’ dx* df’ dx" _ dif* dx“ 
d? “ “ dxi dx’ dS* dx" “ d^ d? 


i not summed 


and, since the f*’s are independent, 

dx' _ dx’ dx^ ^ dx* ^ ^ ^ ^ 

dx^ dx^ dx^ dx* di^ dx® dx^ dx® dx^ ^ ^ 

These two relations together establish the assertion of the lemma Of course, by 
an identical proof it follows that 

dx* dx® _ 

^ dx^ “ 


LEMMA 2 

If </>* and 0’ (i = 1,2, 3) are, respectively, functions of xh x*, x® and f \ x*, x®, then 

df* , - dx® 

0' = 0“ implies 0’ — = 0® 

and conversely. 

PROOF To provide us with further insight into the efficiency of the summation 
convention, let us first prove this lemma using the more familiar 2 notation We 
are given the relation 
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dx^ 

If we now multiply both sides of this equation in its second form by ~ and then 
sum over we hare 

2 


i-i 1-1 ' ^-1 ' 

or, interchanging the order of summation on the right, 

2 ^ "dF ~ Z 2 d'F 

1-1 0-1 ^ t-i ' 


Now, by Lemma 1, the inner sum on the right is equal to 5^“ Hence, the right-hand 
side reduces to 

0-1 

which 18 equal to zero unless ^ — a Therefore, finally, 
h . - dr“ 


as asserled 


Using the summation convention, our proof would have proceeded as folloAvs 
Introducing the dummy index d in place of a, we begin with 




dx" 


Now, multiplying both sides by -A, and using Lemma 1, we have 


dj* 

- dj" dx^ dx‘ 


0^50“ 0“ 


dx‘ dx* dx^ 

The converse assertion is, of course, established in exactly the same fashion 

LEMMA 3 

If 0'-' and 0*^ (i,y =1,2, 3) are, respectively, functions of xh x^, x^ and x^ i". 
then any one of the relations 

I dx" dx^ 
dx" dx^ 


0'- = 


dx^ dx" 


0'^- 


dx‘ 
dx“ dx^ 


dx^ 


dx' dx" 
implies each of the others. 

PROOF Because of the near-identity of the arguments, it will be sufficient to 
establish just one of the assertions of the lemma, say the assertion that 


^ ^ dx" dxX 


implies 


_ dx“ dx^ « 

-= 

^ df* ^ 
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To do this, let us write the first relation using a and h in place of a and and then 
let us multiply both sides by — and sum over i and j This gives us, by 
Lemma 1, 




dj“ dx^_ ^ /dj^ d£'\ /dx^ dx^\ 
82^ dx^ ^ \d dx^^) \ d dx^J 


= 


= <t>^^ as asserted. 

In Sees 10 2 and 10 3, when we considered linear trans¬ 
formations such as 


Ti Y = AX and 7’o Z = BY A,B nonsirigiilar 


we observed that the njatiiees of the inverse transformations 
and are .1 and /L h respectively, and that ^he matrix of 

the transformation re.-^iilting when 1\ is followed by 7\ is BA 
Since linear 1 1 ansformations are obviously special cases of the 
transformation (13), it is natural to ask whether general coordinate 
transformations have comparable properties. The answer is Yes, 
and in fact we have the following theorems, the proof of the 
second of which we shall leave as an exercise 


TH EO R FM 1 

If 7\ transformation with Jacobian ./, then the Jacobian J 

of the inverse* transformation T~^ x°‘ = is J~^ 

PROOF By definition, the Jacobian of the direct transformation T is 
I ‘ . dx^ 

» and the Jacobian of the inverse transfoimation T~^ is./ — 

From the definition of matric multiplication, the element in the tth row and jth 

column of the product Jj is » and, by Lemma 1, this sum is equal to 6/. 

Thus, 

jJ = II5/11 = 1 

Hence, J = that is, the matrix J of the inverse transformation T~^ is the 
inverse of the matrix J of the direct transformation T, as asserted 



COROLLARY 1 

dx* 

If J IS the Jacobian of the transformation T xf^ = x^{x^,x^,x^), then — is equal 

dx^ 

to i/\J\ times the cofartor of in |J| 


THEOREM 2 

If Ti: is a transformation with Jacobian Ji and if 

Tj 

IS a transformation with Jacobian Jt, then the Jacobian of the transformation 
rjT, is JiJi. 
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(17) 


(18) 


(19) 


Let US now determine how the fundamental differential 
quadratic form {dsY = g^j dx' dx^ transforms when the coor¬ 
dinates x\ I*, X* are transformed into the coordinates 
by means of Eqs. (13) For dx' and dx^ we have, of course, 

dx* = dx® and dx^ = ^ dx^ 


Hence, (ds)® becomes the quadratic form 




dx' ^ 


dSf* dx^ 


Therefore, if we write the quadratic form after transformation as 


dSf^ dx^ 


it follows that the coefficients §ap transform according to the law 


_ dx’^ dx^ 

0.0 - 


as we verified in the particular case of a transformation from 
rectangular coordinates to oblique coordinates in the last sectior 
[Eq (26)] Of course, considering the transformation from x-coor- 
dinates to x-coordinates, an argument identical with the one we 
have just given provides us with the companion formula 

dx® dx^ 

g., - 

which also follows from an obvious modification of Lemma 3 
Formula (18) also leads to the following interesting conclu¬ 
sion . From the rule for the multiplication of matrices, the element 
in the zth row and jth column of the product nf^GJ is 

dx® 

dx* dx^ 

However, by (18), this is the element g^j in the zth row and jth 
column of G. Hence, taking determinants, 

dx® d^'* 
dx‘ dx^ 

or, finally, 

= 1(?1 


= I?., I or \J^GJ\ = \G\ 


EXAMPLE 1 

Obtain the formula for the differential of arc length in spherical coordinates 

Since we know the formula for the differential of arc length m rectangular coordinates, 
namely, 

(20) (day - (dx)« + (dyy -|- (dz)* 

we can obtain the corresponding formula m spherical coordinates by transformation from 
rectangular coordinates To do this, let j*, i*, a:* denote, respectively, the rectangular coordinates 
X, y, z, and let f *, 2* denote, respectively, the spherical coordinates r, 6, ^ (Fig. 13 6). Then, as 
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“ r' Bill jr^ COB r"* 
T”i am j" Bin j® 


jS = f' COB 7* 


ax‘ 




ax' 


— 

«= Bin X® 

cos x"* 

- “ x’ COB X® COB X® 

— 

” — 2' Bin 2* Bin 2' 

dX^ 



dx® 

ax* 


<5x* 



Ox® 

ax® 


■— 

“ sin X® 

sin X* 

a= jl COB X® Bin X® 


2‘ Bin 2* COB 2* 

dx^ 



dx® 

a2» 


3x® 



dx® 

ax* 


— 

= COB X® 


— = —X* Bin x‘ 


« 0 

dxi 



dr® 

ax* 



Hence, auhstituting into Eq (17) and noting from E(| (20) that g,j «= 6,\ we have 
ffi, “= (Bin f* cos f®)® + (am f® sin j®)® -f (cob f®)® 


« 1 


^22 = (i‘ COB f® COS i®)® + (x^ COB X® Bin x®)® + ( —x* cos X®)® 

- (xM* 

^83 » ( —Bin X® am x*)® -}- (x* sin x® cob i®)* 

» (x^ Bin X®)® 

^12 “ (sin X® COB i®)(f’ COB i® cos x®) + (sin x® sin x®)(i* cob f® am £‘) + (cos f®)( —f ‘ Bin 2®) 

- 0 

gii =» (am x® cos f*)( —sin x® am f*) + (sm f® Bin f*)(f* am 2® cob f®) 

- 0 


^ 2 j “ (x‘ COS X® cos x®)( —X* am x® sm x®) 4- (x® cos f® sm 2®)(f® sin x® cos x®) 

= 0 

and, finally, 

(dfi)> - d£' dx^ 

- (dx*)* + (2»)®(d2*)* 4- (f Bin X®)® (di®)® 

- (dr)® + r®(dE)* 4- (r am E)*(d^)® 



616 


TINSOR ANALYSIS 


CHAP. 13 


( 21 ) 


( 22 ) 


(23) 


When the coordinates j*, are replaced by the coordinates 
f there is, of course, a new set of parametric curves passing 
through an arbitrary point P and, hence, a new set of base 
vectors 6i, ^ 2 , 6a and a new set of reciprocal base vectors 
To obtain the relations between the old and the new base vectors, 
let us consider an arbitrary infinitesimal displacement ds expressed 
m terms of each system. 

ds *= dx“ Cfl = di" 6» 


Now, from the transformation equations, we have 


dx“ 


and, hence, from (21), we can write 
dx'^ 

dx^ Ga = 6 , 


Now the difl'erentials are arbitrary, therefore, the coefficients of 
corresponding differentials on each side of the last equation must 
be equal. Thus, 


e„ 


dx^ 


6* 


Similarly, or by Lemma 2, 


6. = 


ex' 


e„ 


P'ormulas (29) and (28) of Sec. 13 2 were, respectively, of course, 
special cases of these relations 

Knowing from h]q. (6) how the local base vectors are expressed 
in terms of the local reciprocal base vectors in any coordinate 
85 ^steni and knowing from Eq. (23) how the local base vectors 
transform, we can now determine how the local reciprocal base 
vectors transform For, beginning with the relation (0) for the 
new coordinate system, namely, 


6» = 

and substituting from Eqs (17) and (23), we have 
dx“ dx^ - 

e, - 

dx* 

Now, multiplying this equation by ~~ and summing each side 

over i, we obtain 
/ dx'\ ( dx‘\ dx^ 

VaF aF) dir) ~di> * 

or, using Lemma 1, 
dxf^ 
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Now, if we multiply the last equation by and sum over 7 , 
making use of the fact that |i^"^|| is the inverse of ||f;,;|| and, hence, 
that g^'^gyfi — 8^^, we have 




(24) 

and, using Eq (7), 

dx^ 

(25) 

Similarly, or by using Lemma 2 , 

X 


(26) 


( 27 ) 


Equations (.SI) and (SO) ot Sec. IS.2 were, of course, respectively, 
special cases of these relations 

From Eq ( 8 ) applied to ihe new coordinate system, we have 

6 ' ■ = g'^ 

Hence, using (2.'')), we have 




or, since e“ ‘ e 
Sx^ dx^ 


= 0^^ 


. dx^ di'^ 


which IS the law of transformation for the ^'^'s. Equation (27), 
Sec IS 2, IS a special case of this result Similarly, or by Lemma 3, 




, ux" Sx^ 

nr- — 

^ dx^ dx^ 


Wlien a vector rcpiesented contravaiiaiitly, that is, a vector 
expressed in teiins of the local base vectors Ci, e^, 63 , say 

F“ = C^Ci + V^e2 + C*C3 = V^Ca 

IS expressed in terms of the corresponding local base vectors 
6 ], 62 , ^3 of a new coordinate system, we have, using ( 22 ), the new 
representation 

Hence, the components of a contravariant vector transform ac¬ 
cording to the law 

-1 a 

ti* = --— V" 

dx^ 

Similarly, for a vector represented covariaiitly, that is, a 
vector expressed in terms of the local reciprocal base vectors, say 

Va = ViB^ vse* + Vie* = 
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( 28 ) 


we have, using (24), the new representation 

Hence, the components of a covariant vector transform according 
to the law 

^ dx® 

— 


Equations (33) and (32), Sec. 13.2, were special cases of Eqs (27) 
and (28), respectively 


EXERCISES 


1 


2 


If the range of each index le 3, write out each of the following sums 
a f{xx) b a^jxaj 

c d 




ax* ay} 

f-2, 

dy^ ax’* 


dx* ayi 

g-- 

dy> di* 

If the range of each index is n, show that 


a Bj* “ Bk* b = 5/ = n 

c d = .4M* 

e 5/>l ijk fit* •“ A,xi 

5 Write out the proofs of Theorems 1 and 6, Set 10 2, using the summation convention rather 
than the 2 notation 

4 Write out the proofs of the remaining assertions of Lemma 3 

6 Prove the following lemma If <t>^j and 0,, (ij = 1, 2, 3) are, respectively, functions of x^ x*, 
X® and f S X*, x®, then any one of the relations 




dx“ dx^ 

0afl - - 

dx* dX^ 


dx* dx® 

d? ” ^ 


ix) 


d£* 


<t>aP 


dx^ 

dx' 


di* df^ 

implies each of the others 

Each of the following problems refers to a cylindrical coordinate system 

6 a What is the differential of arc in cylindrical coordinates? 
b What are G and G Mn cylindrical coordinates? 

7 a What are the lengths of the local base vectors at (2,0,0)? at (2,0,1)? at (2,x/3,0)? at 
(2,ir/3,l)? 

b What are the lengths of the local reciprocal base vectors at each of the points in part a? 
0 If Cl, Cj, Cs are the base vectors at the point (2,jr/3,l) and if 

U — 2ei -f 3 o!i -b ca and V =*- Ci — Cj + 2es 
what IS the length of U? the length of V? the angle between U and V? 
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9 Let V be the vector extending from the pomt (2,0,1) to (2,r/3,l). fixpress V in terms of the 
base vectors at (2,0,1) and also in terms of the base vectors at (2,ir/3,l) Check the length 
of V, using each of these representations 
10 Work Exercise 9 using the reciprocal base vectors at (2,0,1) and at (2,9r/3,l) 


13.4 


Tensors 


( 1 ) 


In the last section, without having referred to them by name, we 
were already working with tensors I\ow, wilh the experience we 
have gamed from our discussion of coordinate transformations in 
three dimensions, we can make the matter explicit 

Let and ,j") be generalized co¬ 

ordinates 111 n dimeii'-'ions, and let the two systems of coordinates 
be related by the transformation equations 

T == r(x\x^, ,x'‘) ^ ^ J 2 n 

r-i a> 

Once we pass beyond the three-dimensional space of experience, 
geomcti'K ml lilt ion is of hi tie help to us However, it can be 
shown that m 7i dimensions, just as in three dimensions, there are 
n parametric curves passing through an arbitrary pomt and on 
each of these curves one and only one of the generalized coordmatevS 
vanes Moreover, if the Jacobian determinant of the trans^nrma- 
tioii (1) IS different from zero, vectors tangent to the parametric 
curves thioiigh an arbitrary pomt can be shown to be linearly 
independent. Hence, if local base \ectors e. (t = 1, 2, , n) 

are defined at an arbitrary point P by the conditions that 

= 1©^ = \/e, • e, i not summed 

any vector originating at P can be expressed as a linear combina¬ 
tion of these vectors Furthermore, a set of independent local 
leciprocal base vectors e" (i = 1, 2, . . , n) can be defined at 

any point P by the same conditions we used m three dimensions, 
namely, 

e* • e, = 6/ 

and any vector originating at P can also be represented as a linear 
combination of the reciprocal base vectors at P. In fact, all the 
results of the last section, with the exception of those involving 
scalar triple products, are equally correct in n dimensions, pro¬ 
vided only that the summation convention is understood to cover 
the range 1 to n instead of the range 1 to 3. 


t Just as in three dimensions, we assume that the metrical properties of 
n-dimensional space are defined by a positive-definite differential quadratic 
form (^)* — g^J dx' dx’, — 1, 2, , . , n, whose matrix 0 — l|yt>l| ifl» 

of course, nonsmgular 
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By a scalar, or tensor of rank zero, we mean a quantity S 
whose descriptions in the two coordinate systems are connected 
by the relation 

. . . ,x") = S(x^,x^y . 

By a contravariant vector, or contravariant tensor of rank 1, 

we mean a set of n quantities called components, whose descrip- 
tions in the two coordinate systems are connected by the relations 

. . .t") = . ,x“) — 1 = 1,2, . ,n 

d£'^ 

Since dx^ = dx^, it follows that the difTerentials of the coor- 

oxr 

dmate variables are the components of a contravariant tensor of 
rank 1 

By a covariant vector, or covariant tensor of rank 1, we mean 
a set of n quantities also called components, whose descriptions 
in the two coordinate systems are connected by the relations 

l,(x\x^, . . ,x") = . ,x") t = 1, 2, . . n 

If 0 is a scalar point function [for which, therefore, 

0(x*,f®, ,x") = </>(x*,i’, ,x*) 


then 

_ d4> dxf 
dx^ Sx^ dx* 

Sif> 

Hence, the n quantities — are the components of a covananl 

tensor of rank 1, which we recognize as the gradient of </> 

A contravariant tensor of rank 2 is a set of quantities 
whose descriptions in the two coordinate systems are connected 
by the relations 




dx' d£’ 
dx“ dx^ 


h3 = 1 , 2 , 


, n 


From Eq (26), Sec 13.3, it is clear that the elements of the 
matrix form a contravariant tensor of rank 2. 

A covariant tensor of rank 2 is a set of n} quantities whose 
descriptions in the two coordinate systems are connected by the 
relations 


dxf* bx^ 


( 6 ) 


V = 1, 2, . . . , n 
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From Eq. (17), Sec. 13 3, it is clear that the elements of the 
fundamental matrix G form a covariant tensor of rank 2. This 
tensor is often called the fundamental metric tensor. 

A mixed tensor of rank 2 is a set of n} quantities whose 
descriptions m the two coordinate systems are connected by the 
relations 


I 

S) 


t a ^ ^ 

dx^dx^ 


Although we shall leave the proof of th's fact as an exercise, 6 / is 
an example of a mixed tensor of rank 2 

A tensor such that for all values of 

i and j is said to be symmetric. A tensor (^.j) such that 
for all values ot i and j is said to be skew- 
symmetric or alternating. 

The coiK ept of a tensor can. clearly, be generalized i-o include 
tensors of arbitiary rank r with any number k (0 ^ h r) of 
covariaiit indices and r — k contravariant indices For instance, a 
set of n“ quantities whose descriptions in the two coordinate 
systems are connected by the relations 


_ ta0 ^ ^ 


constitutes a mixed tensor of rank 5 with two contravariant 
indices t and j and three covariant indices u, v, and w 

From the definition of a tensor as a set of quantities which 
transform in a prescribed way, it is clear that a tensor can be 
constructed by specifying its components in one coordinate system 
arbitrarily and then letting the appropriate transformation laws 
define its components in all other coordinate systems 

The algebra of tensors is based primarily upon the following 
observations 

Two tensors are equal if and only if they have the same rank 
and the same number of indices of each type and have their cor¬ 
responding components equal in one and, hence, ui all coordinate 
systems. In particular, if the components of a tensor are all zero in 
one coordinate system, they are all zero in every coordinate system. 

If Ti and T 2 are tensors of the same type, then the set of 
quantities obtained by adding respective components of T i and 
T 2 is a tensor Ti + Ta of the same type as Ty and T 2 

If Ti IS a tensor of rank r\ with Ci contravariant and 71 
covariant indices and if T 2 is a tensor of rank r 2 with C 2 contra¬ 
variant and 72 covanant indices, then the set of quantities 
obtained by multiplying each component of Ti by each com¬ 
ponent of Ti IS a tensor T 1 T 2 , called the outer product of Ty and 
Tit rank ri + r 2 with Ci + C 2 contravariant indices and 71 + 72 
CO variant indices For instance, if Ti is the tensor and Ta is the 
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( 8 ) 

( 9 ) 


tensor then the general term transforms according to the 
law 



tafit y ii' ^ 

^ ax“ dx^ dxy dx^ 


which shows that TiT^ = is a tensor, say of rank 4 with 
3 contravanant and 1 covariant indices. 

If, in a tensor of any type, a contravanant index is suniined 
against a covariant index by simply setting one index equal to the 
other and thereby invoking the summation convention, the result¬ 
ing set of quantities is a tensor with one less contravanant index 
and one less covariant index For example, since the tensor 
transforms according to the law 


Ji' = if 


dx^ ax'* 

^ dx'^ 


we have, setting j = k, 

h, = t.tf i*’ 

*■' dr- ax» dx’ 

~ if ~^^ Ijcmma 1 , Sec 13 3) 


= i‘ 


11 ' 

dx® 


since only when jS = 7 is 6 ^"^ 0 . Hence, transforms as a 

contravanant tensor of rank 1 , that is, is a contra variant 
vector, say rj'- This process of obtaining one tensor from anollicr 
.IS known as contraction. Obviously, the process of contraction 
can be repeated as long as t here are indices of each type When 
the process of contraction is applied to the product of two tensors 
m such a way that at each stage one of the two indices belongs to 
the first factor and the other to the second, the resulting tensor 
IS said to be the inner product of the two tensors with respect to 
the given set of indices 

The converse of the last observation is also important A set 
of n’’ quantities is a tensor provided an inner product of the set and 
an arbitrary tensor is also a tensor. The proof of this assertion 
should be sufficiently clear fioin the argument for the specnil 
case r = 2 Suppose, then, that is a set of n^ quantities such 
that, for an arbitrary tensor of the second rank, say we have 

= ra“ 

where {'a® is a tensor. Under an arbitrary transformation of coor¬ 
dinates we have, of course, 

Now, since and are tensors of the indicated type, we have, 
by definition, 

dx^ dx' 


dx® dx* 
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Hence, substituting into (9) and then using (8), we have 


^ dxO ~ 


dx^ d3^ 


dxf dx^ 




d£^ dx^ 
dX^ d? 


From this, by transposing and collecting terms, we obtain 



If we now form the inner product of the expression on the left 
Sx^ 

with and recall from Lemma 1, Sec 13 3, that 


dx^ dx^ 


we have 

or 




cti‘ 

dxK 




Now, since is completely arbitrary, it may be chosen, in turn, 
to be a tensor each of whose components except one is equal to 
zero Hence it follows that the expression in parentheses in the 
last equation must be identically zero. Therefore, 





dx^ 

dx'^ 


Finally, if we form the inner product of each 

1 1 • T r. 

equation with and again use Lemma 1, Sec 




df “ dx^ 
dx^ dx* 


member of this 
13.3, we nave 


or 


-r . dx^ . dj‘ 

ar" a? “ dj;"" 


which is precisely the law of transformation for a mixed tensor of 
rank 2. In other words, f,® is a tensor, as asserted The property 
we have confirmed in this particular case is often referred to as 
the quotient law for tensors 

The preceding observation is frequently the most effective 
means of proving that a set of quantities is a tensor For instance, 
by its use we can establish the following interesting result If the 
elements of a nonsingular matrix l|/,j|| are the components of a co- 
variant tensor of rank. 2, then the elements of the inverse matrix ||/''|| 
are the components of a contravanant tensor of rank 2. To prove this, 
let be any contravanant vector. Then, by the process of 
contraction, 

= /.a^“ 

18 a covariant vector. Moreover, since ||/„|| is nonsingular and 
IS arbitrary, is also arbitrary; that is, any covariant vector rii 
can be obtained in this fashion from a suitable contravanant 
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vector t®. If we now form the inner product of each member of 
the last equation with we have 

However, since \\ftj\\ and ||/"^|| are inverses, it follows that 
Hence, /% = 

Since rfi is arbitrary, it follows from the quotient law that is 
a tensor, as asserted 

EXERCISES 

1 Verify that S/ la a mixed tensor of rank 2 

2 a Is ii' a tensor*^ b Is 6,* a tensor? 

8 Verify that, if 7"i and Tt are tensors of the same type, then Ti ± T 2 is also a tensor of iliat 
type. 

4 Verify that, if T la a tensor and ^ is a scalar, then the set of quantitiea obtained by multiply¬ 
ing each component of T by </» la a tensor of the same type as T 
6 a Is a tensor obtained if two covariant indices in a tensor arc summed against each othci'^ 
b Is a tensor obtained if two contravanant indices in a tensor are summed against each 
other? 

6 If the elements of a nonsingular matrix |l/j‘ 1| are the components of a mixed tensor of rank 2, 
do the elements of the inverse matrix form a tensor? 

7 a liCt be a set of n* quantities, and let be an arbitrary contravanant tensor of rank 

2 Show that is a tensor if the produc t ib a tensor 

b Show that is a tensor if its inner product with an arVjilrary covariant tensor is also u 
tensor 

8 a Show that (a /3 is a tensor if its inner product with an arbitrary mixed tensor 77 ^^ is a tensor 

b Show that f®^ is a tensor if the product ^ tensoi, 77 ^ being an arbitrary covanan t 

py py 

tensor of rank 2 

9 If 17 ^^ is an arbitrary tensor of the indicated type, show that the n* quantities $®^ form a 

tensor if the product is a tensor f-y* 

10 Show how the contravanant representation of a vector can be obtained from its covananl 
representation, and vice versa 


13.5 

Divergence and curl 

We have already seen (Sec 13 4) that, if ^ is a scalar point func- 

tion, then ^ is a covariant vector, which we recognized as the 

gradient of 0. We now turn our attention to the determination of 
the divergence and curl of vectors in generalized coordinates 

P"or the divergence of a contravanant vector we have the 
expression 

/i\ Id, /TTTI 
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A3S 


^ 2 ) 


(3) 

(4) 


(5) 


( 6 ) 


where G is the metric tensor of the space In rectangular coor¬ 
dinates, for which 



1 

0 

0 

G = 

0 

1 

0 


0 

0 

1 


this IS ( learly the divergence, as defined in Sec. 12 3 However, 
before this can be accepted as a definition of the d’vergence in any 
coordinate system we must prove that it is a f "alar invariant; 
that IS, that it is the same in all coordinate systems To do this, 
lot us consider the given expression in ?• second (oordinate system’ 






U i' + 

/ I .. V -N =1 ' 


\2 vVl'l 



1 

2 Iff I dx" dx* ** dx* 


By hypothesis, is a contravanant vector Hence, 


r = 


dx* 

dx- 


and 
- dx® 

ta 

' dx* ^ 


Also, from Eq ( 10 ), Sec 13 3, \G\ = |(7l \J\~-, where J is the 

Jacobian of the transformation Therefore, by differentiat;ng and 
dividing by |Cj|, we obtain 

j_ ^ _ j_ dj^ A 

Iff’I dx® I(71 dx® \J\ dx“ 


Thus, substituting from Eqs (3), (4), and (5) into Eq (2), we 
have 


d . 


^-(V|61 1 -) 

V| 6 '| 


1 /j_ 

2 Vl^l dx- 



2|(7| dx- ' dv 'dxf ' dx'-djf'di' 

f. + 4 f 

\ 2 jr 7 | dx® ^ dx®/ ]7| dx® / 




Now, the first (plantity in parentheses in the last expression is 
precisely 


VIGI 


Hence, our proof will be complete if we can show that the second 
quantity in parentheses is zero. To do this, we recall from the 
rule for differentiating determinants that the derivative of \J\ is 
equal to the sum of n determinants, the ith one of which is 
identical with \J\ except that the ith row consists of the deriva¬ 
tives of the elements in the zth row of |J|. Hence, if we denote by 
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( 8 ) 


Ji^ the cofactor of the element in the ith row and bth column of 
\J\j then, in expanded form, 

a** dxf‘dx/‘ ' 


However, by Corollary 1, Theorem 1, Sec. 13.3, 

= S 

Hence J. ^ f£‘ 

|J| dxf‘ dx“ dx” dx' 

and, thus, the second quantity in parentheses in (6) is indeed zero; 
and the scalar 


VW] 


iVW\ (‘) 


13 invariant and, hence, equal to the divergence in every coordinate 
system. 

If we use the covariant representation instead of the con- 
travariant representation then, since 




(see Exercise 10, Sec. 13.4), we have for the divergence 


1 _d_ 


(VWI 


If fa is the gradient of a scalar point function, that is, if fa 
is the covariant vector then its divergence is called the 
Laplacian of 0. In other words, in generalized coordinates, 


VV = 


1 _a^ 

VW\ 



EXAMPLE 1 


Obtain the expression for in cylindrical coordinates 

By direct calculation, as m Example 1, Sec. 13 3, or by observing from a figure that 


(ds)* - (dr)> + (rdey + (dz)> 
wp find that, in cylindncal coordinates, 


111 

0 

0 


1 

0 

0| 

o 

1 

1 

r* 

0 

and Q-^ - jig* Ml 

0 

l/r« 0 

II0 

0 

1 


0 

0 

ll 


Therefore, from (8), 


V *0 


1 



r 


ja/ a *\1 

L 6r y dr J d9\ r* dS J dz y / J 

K av ^ aA 1 av ^ a**"] 


1 d*<t> 1 d<l> 
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Consider, now, an arbitrary covariant vector {o. From its 
law of transformation 



we have, by differentiation, 

^ = ii? ^ ^ -L t 

dx* d£“ 

Similarly, of course, 

dx“ dx* dV 
d£“ dx" d5“ di^ d;g“ d^^ 

Hence, subtracting the last two equations, we have 

^ ^ ^ _ dj,\ ^ ^ 

dx^ di“ \dx* dx“/ di“ di^ 

where the other terms cancel, since the order of partial differentia¬ 
tion IS immaterial and since a and b are just dummy indices From 
the law of transformation defined by the last equation, it follows 
that 

^ _ 1^** 
dx** dx* 


18 a covariant tensor of the second rank. Clearly, it is a generaliza¬ 
tion of the familiar notion of the curl of a vector. 

More specifically, in three dimensions, let ^ab be an arbitrary 
alternating covariant tensor of the second rank, for which, by 
definition, ^ab = — fto. From fa* we can construct the expression 


3 ^Ue“ X e^ = ^126^ X e* + ^236* X e* -j- £316* x 


Moreover, if we use the fact (see Exercise 1, below) that 
e' X = 7 ——— ij,k any cyclic permutation of 1,2,3 

[616263! 

we can write X 6* in the form 


f- If- _|_£ 

[616263] ^ [616263] ^ [616263] 

from which it is clear that J^£a*e® X is a contravariant tensor 
of rank 1 Finally, if we recall from Eq (12), Sec. 13 3, that 

[616263]* = \G\ 

we can write this tensor in the form 


: 61 + 


^3 


; 62 + 


-VW] -VWl 


- VW\ 

If £ai 

Sion (9), with the negative square root used, as indicated, is 
precisely the curl of £«, as we defined it in Chap. 12, Sec. 12.3. 


d£ d£ft 

^ where £« is a covariant vector, then the expres- 
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EXERCISES 

1 Usuig Eqs. (9) and (10), Sec. 13 3, or otherwise, show that 

01 01 01 
0* X 0* - 0' X 0* - r—0» X 0* - I—^ 

[010|0|1 Iei0t0il [0i0t0il 

2 ■ What is the divergence of a contravariant vector in cylindrical coordinates? 
b What is the divergence of a covariant vector in cylindrical coordinates? 

5 a What is the divergence of a contravariant vector m spherical coordinates? 
b What is the divergence of a covariant vector in spherical coordinates? 

4 Obtain the expression for VV m spherical coordinates. 

6 If is the gradient of a scalar function show that the curl of (a vanishes identically 


13.6 

Covariant difforontiation 


Since the components of a tensor are functions of the generalized 
coordinates, it is obvious that they can be differentiated partially 
with respect to the coordinate variables However, the quantities 
thus obtained are of no intrinsic interest since they are not the 
components of a tensor. For instance, if is a contravariant 
vector and if we differentiate the transformation equation 



( 1 ) 


partially with respect to £^, we have 


_ df" dx* df« dx* 

d£^ dx* d£^ dx^ ' dx* dx^ d£^ 

Clearly, if the second term on the right were not present, ^ 

would be a mixed tensor of rank 2, since the first term on the 
right in (1) is precisely what is given by the law of transformation 
for a tensor with one covariant and one contravariant index. It is 
also interesting to note that, if the equations connecting the two 
sets of generalized coordinates are linear, as they are for trans¬ 
formations between rectangular and oblique coordinates, then 
the second term is missing. These observations raise the impor¬ 
tant question of whether or not it is possible to add “correction” 

df** 

terms Ob'* to the partial derivatives ^ so that 




will be a mixed tensor of rank 2. This is indeed possible, and, 
although we cannot go deeply into the matter, we shall determine 
the appropriate “correction'’ terms and define the so-called 
covariant derivative. 
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From Eq (1) it ie almost obvious that the terms to be added 
to ^ to eliminate the second sum should be linear in the {'s, say, 


( 2 ) 


(3) 

(4) 


and this is actually the case. To determine the coefficient function 
Fflft'*, we begin with the metric tensor gab From its law of trans¬ 
formation, namely, 

_ dx® dx^ 

g.f - ga 

by differentiating each side with respect to .f'*', we obtain 

_ dgab dx^ dx® dx^ r d’'/® dx*l 1 dx® d^x* \ 
di-’ ~ dx‘ dx' d£“ dx^ + af“ 5?“ dh d«''j 

From this, by first interchanging ^ and 7 and then interchanging 
7 and a, and making the corresponding permutations of the 
dummy indices a, 6, c in the first term, we obtain, respectively, 

dg„y _ ^ar dx* dx® dx"" d^x® dx* I dx® d’x* | 

~ dF“ W' WdT“ Ji' C'* di" W dF'l 

d§y 0 _ dgeb dx® dx® dx* r d^x“ dx*1 ^ 

di- ~ d^ dJ" df^ dl^^' di«J di^di^ 

Now, subtracting (2) from the sum of (3) and (4), noting that the 
quantities in brackets and the quantities in braces cancel respec¬ 
tively, we obtain 

_ d§aj ^ ^ ^ 

dx“ dx^ dx^ \dx® dx* dx ®) dx® dx^ d.g'^ 

dV dx* dx® ^»X*_ 

as'* di“ df T di' d£‘ di> 


Finally, interchanging the dummy indices a and h in the last term 
and recalling that g^a = Qab, we have 

(C,\ ^£ya , ^7 _ ^ I ^ _ ^g»t \ 4 . 2o 

di" 5x* dx’) di’di.^ df dt‘dS^ dl,' 

The quantities 

('fit r ^ ( ^£1* -L ^^®® 

whose law of transformation is given by Eq. (5), are known as 
Christoff el symbols of the first kind.* Incidentally, because of 
the second term on the right in the transformation equation (5), 
it is clear that Fe.oi is not a tensor. 

The Christoffel symbols of the second kind are, by definition, 
the quantities 

(7) r,." = 


Named for the German mathematician £. B. Christoffel (1829-1900). 
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To obtain their law of transformation, we begin by recalling from 
Eq. (26), Sec. 13.3, that 


Hence, 

r.,* = rry.., = I r 


\ dx" dx^ 


— ^Sa0 \ 

d^y} 

= - (^ r (^ -I- ^X° dx^ dx^ 

2 y sx^ dx^) [vax“ dx* ax ^) ai“ ax^ ax> 


+ 2(7ofc 


a^x" 

ai“ ai^ 


(^gdb 

, d^oo 

^QaJ^ 

ax® ax* ax* 

' dx” dx’'" 

\dx“ 

ax* 

) 

1 ax“ dx^ dx^ 

di"' dx’ 


+ g^'gob 


a*x“ ax* r ax* ar 


> ax' 


r ax 

[di 


ax° a^ _ ^ ^ 
ax'*' ^ ' 


and 




f J ^}: ad. {^» + ?»“/ _ 4. od»„ , 

“* 2^ \da:” ^ da* dx‘ / dx- dx^ dx'‘ ^ 9x9 


' dS» dx» dx'' 

Now, by Lemma 1, Sec. 13.3, the bracketed terms become 

ax*" dxy 
dxy ax' 

Therefore, the last equation simplifies to 

' dx^ dx^ 

Furthermore, since ||^7*^|| and \\g,j\\ are inverse matrices, it follows 
that 

Q^Qab — Q’^^Qba — 

Hence, the last term in the preceding equation reduces to 

a*x“ ax* 
ax“ d£^ ^ 

and we have, finally, the law of transformation 




-a^o(^ 1 ^ _ ^Gab \ ax° ^ 

2 ^ \ ax“ ax* ax ") ax“ ax- 


a^x* 


= gdcT + 

*' ax* ax» dx^ ^ af* ax" ax* 


ax* ax* 
^ a^^ 
ax* 




a^x'' ax* 

ax“ ax^ ax® 


= r i 

^ ' 


a*x® ax* 


ax® ax^ ax'^ af- a^^ ax® 

Because of the second term on the right in (8), it is clear that Fob^ 
like Fc.oft, 18 not a tensor. 

We can now establish the fundamental result that ^ + Fob'^r 
IS a mixed tensor of rank 2. In fact, knowing the law of transforma- 

Qtd 

tion for namely, Eq. (1), and the law of transformation for 
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(9) 


( 10 ) 


( 11 ) 


TaA**, namely, Eq. (8), we have 

il' + r .‘f• = ^ ^ ^ 4. ^ 

dx* “ d** di* dx^ ' 3i* d£> 

/ ,aT«ax»ai* 3«x* af*\ ai!» 

\ •* ai* di>‘ dx* af af 0 ax*/' ax* 

or, replacing the dummy index d by t in the second term, replacing 
the dummy index a by b in the fourth term, ant' observing that in 

the third term = 5.“ 

af“ ax* ’ 


ii' 4- r n- = ^ ^ -I- f 

axo « ax* ax* ax" ' ax* ax- ax" 


+ 




ax* ax* af“ af" ax* ax* 


-(g+tr. 


Aax*^* 
') ax« ax* 

i 


a*x* a*' a£“' 
ax* ax* ax* a** ai» ax* ax' 


a»f* ax* , 

Si + 


^x^(^ ~ Hence, differentiating with respect to x\ we 

have 


dV ^X* dV dx" 

dx" dx* dx^ dx^ dx® dx^ dj‘ 


Therefore, the expression in brackets in Eq (9) is eqiiai to zero, 
and we have 


-I- r 

d-g -I- ad 




d^ dx« 
dx^ dx^ 


which proves that 


is a mixed tensor of the second rank, as asserted 

The expression (10) is called the covariant derivative of the 
contra variant vector and is frequently denoted by the symbol 

dx* 

In very much the same way it can be shown that, if is a 
covariant vector, then 


dx* 




is a mixed tensor of rank 2. This expression is known as the 
covariant derivative of the covariant vector fd, and is denoted by 
the symbol 

Dii 
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( 12 ) 

(13) 

(14) 


It can also be shown that any tensor has a covariant deriva¬ 
tive, in which a term like the second term m (10) enters for each 
contravanant index m the tensor and a term like the second term 
in (11) for each covariant index Thus, for tensors of the second 
rank, we have the formulas 


dx^ 

dx* 

D^dt 


I? + r.6‘'{’' + ra-j* 
^ 


b Show that Tab^ ■» rfca**. 


EXERCISES 

a Show that Tj.** - r^.ba 
c Show that 

dx^ 

d Show that a neceesary and eufficient condition that the Chnatoffel symbols all be zero is 
that the gt/a be constants 

a Calculate the Chnstoffel symbols for a cylindrical coordinate system 
b Calculate the Chnstoffel symbols for a spherical coordinate system 
If IB a scalar function and f** is a contravanant vector, show that 

DW) 30 ,, 

- H M ^ ^- 

di* dx* di^ 


Doii 

Prove that —- — 0. 
di* 


Prove that 


dx^ 





CHAPTER FOURTEEN 


Analytic Functions 
of a 

Connplex Variable 


14.1 

Introduction In our work up to this point we have frequently found the use of 
complex numbers necessary or at least convenient. For instance, 
we encountered them in the solution of linear differential equa¬ 
tions with constant coefficients in Chap 2. In Chap. 5 they 
appeared in the complex impedance, which we found of consider¬ 
able utility in the determination of the steady-state behavior of 
electrical circuits. Then, in Chap 6, their use led to the important 
complex exponential form of Fourier senes and ultimatCy to the 
inversion integral of Laplace transform theory. Finally, in Chap. 
9, we found that certain important physical problems required 
the consideration of Bessel functions of complex arguments 

None of these applications, with the exception of the inver¬ 
sion integral, for which fortunaiely we had no immediate need, 
required any knowledge of the properties of complex numbers or 
of functions of a complex variable beyond what is ordinarily 
acquired in courses in college algebra and calculus There are, 
however, large areas of applied mathematics in which familiarity 
with the theory of functions of a complex variable beyond this 
minimum is indispensable In this and the next three chapters 
we shall develop the major features of this theory and illustrate 
some of its more striking applications 


14.2 

Algebraic prelhiiinorief 

By a complex number we mean a number of the form 
z X ly 

where x and y are real numbers and i is the so-called imaginary 
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unit whose existence is postulated such that = —1. The real 
number z is called the real component or real part of z The real 
number y is called the imaginary component or imaginary part 
of z. The real and imaginary parts of a complex number or 
expression z are often denoted by the respective symbols 

(R(2) and B(z) 

It is important to keep in mind that B{z), as here defined, is a 
real quantity. 

Two complex numbers a ib and c id are said to be 
equal if and only if the real and imaginary parts of the first are, 
respectively, equal to the real and imaginary parts of the second. 
In particular, the vanishing of a complex number implies not 
one but two conditions, namely, that both the real part and the 
imaginary part of the given number are zero. 

EXAMPLE 1 

If (x -f 1/ -H 2) -h (x* -I- y)t - 0 

then X -b y -h 2 “ 0 and also x* d- y ■» 0 

From this pair of simultaneous equations it follows necessarily that 

X — 2 and y— —4 or x— —I and y = — 1 

If 2 = X + iy, then the negative of z is the complex number 
— 2 = —X — ly 

If two complex numbers differ only in the sign of their imaginary 
parts, either one is said to be the conjugate of the other The con¬ 
jugate of a complex number z is usually written I or, less fre¬ 
quently, 2*. 

Addition, subtraction, and multiplication of complex numbers 
follow the familiar rules for real quantities, with the additional 
provision that in multiplication all powers of i are to be reduced 
as far as possible by applying the definitive property of i and 
its obvious extensions. 

i* = — 1 

= iH = — i 
ii ^ ^ 1 

i® = iH = i 

Thus (a -h ib) ± (c -j- id) = (a ± c) -h (b ± d)i 
and (a + ib)(c + id) = (ac — bd) -h (be -h ad)i 

Division of complex numbers is defined as the inverse of 
multiplication; that is, (a + ib)/(c -h td) is the complex number 
z = X iy which satisfies the equation (c + id)(x + iy) = a tb- 
Performing the indicated multiplication, we find 

(ex — dy) + (dx -h cy)i = a + ib 
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(3) 


(4) 

(5) 

( 6 ) 


which implies that 


ex — dy = a and dx + cy = b 


Solving these for x and y, we obtain 


_ ac + bd 

" c* + d= 


and 


y = 


be — ad 


Hence, 


a lb _ ac bd be — ad . 
c -}- td c* H" d* c* -h d* ^ 


In practice, the quotient of two complex numbers is usually 
found by multiplying both numerator «,nd denominator by the 
conjugate of the denominator 

a lb a 7b r ~ td ac -[ bd , be — ad , , , „ 

- .—] = ^ 1 “j ‘ " ~ j = I c -h Ml 0 

c td c id c — id r d^ c* -h d^ 


(Conjugate complex numbers have various simple though 
important properties For instance, \i z = x iy, then 

zz = {x iy)(x - ly) = 


which IK a purely real quantity This is the basis for the use of 
conjugates in division Also, 


z I — (x -h \y) (x — ty) — 2x - 26<(z) 
or 

and z — z ~ (x ly) — (x — ly) = 2iy = 2i^(z) 
or 



In taking the conjugate of a complicated expression, the 
following results are of great utility. 

± Z2 = t 52 
Z1Z2 = Sii2 

= P Z2 ^ 0 

Z 2 

The proofs of these all follow immediately from the four laws 
of operation and the definition of conjugates. 



EXERCISES 

1 Prove that, if a number is equal to its conjugate, it ib necessarily real. 

2 Prove that any number is equal to the conjugate of its conjugate 

8 Prove that, if the product of two complex numbers is zero, at least one of the numbers must 
be zero. 
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the other and completing the triangle thus formed, a third com¬ 
plex number is determined whose components are precisely those 
of the sum zi + 22. Figure 14.36 shows the construction for the 
difference of two complex numbers, i.e., for the sum Zi -h ( — 22) 
Evidently, zi — 22 is identical in length and direction with the 
vector drawn from the end of 22 to the end of zi. 

Both the sum and the difference of two complex numbers 
can be described in terms of the parallelogram having the given 
numbers for adjacent sides, for the sum is simply the diagonal 
of the parallelogram which passes through the common origin 
of the two vectors, and the difference is just the other diagonal, 
properly directed. Much of the utility of complex numbers m 
elementary engineering applications stems from the fact that 
they add according to the parallelogram law Since this is the 
experimentally established law for the addition of such things as 
forces, velocities, currents, and voltages, it is evident that in 
two dimensions complex numbers, like ordinary vectors in three 
dimensions, can conveniently be used to represent such quantities 
Although we shall have no occasion to use it, a graphical 
process for multiplying and dividing complex numbers can also 
be devised It is based upon the following exceedingly important 
considerations If wo have two complex numbers given in polar 
form, their product can be written 

2i 22 = [ri(cos di i sm 0i)][r2(cos i sin ^2)] 

= rir2[(cos cos 82 — sin d\ sm B^) + i(sin B\ cos 82 -h cos Bi sin ^2)) 
( 4 ) = fir2[cos (^1 -|- 82) “h t sin (^1 ^2)] 

and their quotient can be written 

^ _ ^cos &i t sin 0i) 

22 r2(cos 82 -|- I sm ^2) 

- ^i(c os 81 + i sm g i) (cos 82 — 1 sm 82) 
r2(cos 82 I sm 02)(cos 82 — i sin ^2) 

_ r\ (cos 8\ cos 82 + sm 8^ sm 8 2) + ^(sm 81 cos 82 — cos 81 sm ^ 2) 
r2 cos^ 82 sin^ 82 

(•V = ~ [cos (8j — 82) -t t sin (81 — 02)1 r2 0 


In words, then, the product of two complex numbers is a complex 
number whose absolute value is the product of the absolute values 
of the two factors and whose amplitude is the sum of the amplitudes 
of the two factors, and the quotient of two complex numbers is a 
complex number whose absolute value is the quotient of the absolute 
values of the numbers and whose amplitude is the difference of their 
amplitudes. The behavior of the angles of complex numbers when 
the numbers are multiplied or divided is concisely expressed by 
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the formulas 

(6) arg Z\Z2 = arg Zi -f arg zj 

( 7 ) arg = arg zi - arg zj 

In Sec 14 7 , when we succeed in writing a general complex num¬ 
ber as an exponential, the reason for the striking resemblance 
of these results to the corresponding logaritlunic formulas will 
become apparent. 

The extension of these ideas to products of more than two 
factors IS obvious, and we can write at once 

ZiZ2 Zn = r„lcos (0, f H- + 

f- I sin (^1 -h ^2 + ' H“ ^n)l 

In particular, if all the are Hit same, we have the important 
result 

(8) 2" = r"(cos nB i sin nO) 

If r = 1, this IS known as de Moivre’s theorem.* Since the law of 
division in polar form ( 5 ) gives 

^ [cos (0 — <?) -h 7 sin (0 — 9 )] — " [cos { — 0) -\- i sin ( — 0)1 

which is just the content of Eq (8) for n = — 1 , it is clear that 
this formula is valid for all integral values of n, both positive 
and negative 

The extension of Eq (8) to roots of integral order iS an easy 
matter In fact, an nth root of 2 = r(cos 9 + i sin 9 ) is defined 
as any number v) = R{cos -f 7 sin 4>) such that 

= /?”(cos n(t> t sin n 4 >) = 2 - r(cos 9 + i sin 9 ) 

Since two complex numbers which are equal must have the same 
modulus, it follows that 

Rn ~ r or 7 ? = r*/" 

It should be noted that only real numbers are involved in the 
determination of R, since r*/" i.s the real nth root of the positive 
quantity r and can be found by an ordinary logarithmic ('alcula- 
tion Atso, the angles of equal complex numbers must either be 
equal or differ at most by an integral multiple of 2^ Hence, 

, 0 -f- 2/c7r 

n<t> = 0 -h 2kTr or <^ = - 

n 

For A: = 0 , 1 , . ,77 — 1 , these values of 0 define distinct 

angles; after this the same angles are repeated, again and again, 
each time with an irrelevant increment of 27 r in their measures 

* Named for the French mathematiciar. Abraham de Moivre (1667-1754), 
although an equivalent form had been obtained earlier by the Euglishman 
Roger Cotes (1682-1716) 
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Thus there are exactly n distinct values of w = 2^^" 


( 9 ) 


( 10 ) 


w 


— 2^/” = rl/w 


< e + 2 fcir , . + 

cos- h X Sin 


- 2kTr\ 
n ) 


k — 0, 1, . . . ,71 — 1 

In the complex plane these are represented by radii of the circle 
with center at the origin and radius spaced at equal angular 
intervals of 27 r/n from the radius whose angle is d/n. 

With integral powers and roots defined, the general rational 
power of a complex number can be defined at once In fact, 


^pIq = 


^ + 2A;7r , e 2A:7r\]p 

cos - h t sin -I 

Q 9 /J 


= j^cos ^(6 + 2kTt) + i sin ~ + 2 fcir) j 

fc = 0, 1, . . . , g - 1 

The definition of 2® when a. is not a rational number, however, 
must be postponed until Sec. 14 . 7 . 


EXAMPLE 1 

Find the four fourth roots of —81 

To do this, we must first write — 8 t in standard polar form 


-8t 




From this, by applying Eq (9), we find that the four fourth roots of — 8 t are given by the 
expression 


or, explicitly, 


8^< j^cos ^ -h i Bin i -f- 2A:ir^ j 

oU / 

rj — 8 ^' I cos-h » sin — I 

V 8 Sj 

au / , 7ir\ 

rJ — 8 ^* I cos — + 1 sin — I 

ou/ ll’T 11A 

r, « 8 >' I cos — + i sm — \ 

15 "- . isA 

Ti - 81 ^ (cos — + t sm — 1 


0 , 1 , 2 , .3 


k ~ 0 

k - 1 


A: - 3 


The coefficient 8 ^^ is, of course, the real fourth root of 8 , the value of which is found by a simple 
logarithmic calculation to be 1.682 


EXAMPLE 2 

Using de Moivre’s theorem and the binomial expansion, express cos 4^ and sin 40 in terms of 
powers of cos 6 and sm B 

To do this we consider (cos $ + i sin 6)* and expand it first by de Moivre's theorem and then 
by the binomial theorem. This gives the identity 

008 40 t sm 40 «■ cos* 0 + 4i cos* 0 sin 0 4- 6t* cos* 0 sin* 0 + 4 t* cos 0 sm* 0 + 1 * sin* B 
“ (cos* 0 — 6 COB* 0 sin* 0 4 - sin* 0) 4 - i(4 cos* 0 sin 0 — 4 cos 0 am* 0) 
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Equating real and imaginary parte of these equal oomplex expreaeione, we obtain the required 

formulae 

COB 4^ — cob‘ ^ — 6 cos* B ein* (9 -f sin* E 
ein 4# 4(cob* B am B — cob B sin* B) 

EXERCISES 

1 Show that multiplying a complex number by i rotates it through 90® without changing its 
length What ia the effect of multiplying a complex number (a) by —t? (b) by \/ 1 ? 

2 A square lies entirely in the second quadrant If one of ita sides joinL the points —3 and 2t, 
find the coordinates of the other two vertices 

8 Find all the distinct fourth roots of —1. 

4 Find all the distinct fifth roots of 32 

6 Find all the distinct cube roots of i 

6 Express the complex number 8 — S \/ 3 t in oolar form, and find its distinct fourth roots 

7 Find the distinct cube roots ol 1 -f i, and reduce eaidi to the form a 4 tb, where a and b are 
decimal fractions 

8 Find all the distinct values of (1 - i)W 

9 Find all the distinct values of ( — 1 — 

10 Using de Moivre’a theorem, oxpiess cos Si? and sin 5^ in terms of poweis of cos B and sin B 

11 Show that, if n is an integer, both cos nB and (sin n®)/(8in B) can be expressed as polynomials 
in cos B 

12 If zi and zj are complex numbers, what point is represented by (zj 4 ri)/27 What is the 
locus of the points Xzi 4“ where X and m arc real parameters and X + u — 1? 

13 SI V that the centroid of a system of three particles of equal mass situated at the points 
Z], Zi, Zi IS the point (zi -}- Z 2 Zi)/3 Where is the centroid of a system of three masses 
nil, nii, and mj situated respectively at the points zi, Zj, and zg'? 

14 Using the polar form of the multiplication law, devise a geometrical construction for the 
product of two complex numbers 

16 Devise a geometrical construction for the quotient of two complex numbers 


14.4 


Absolute values 


We have already defined the absolute value of a complex number 
z as the length of its representative vector; i e., 

1^1 = 

From this it is evident that a complex number is zero if and only 
if its absolute value is zero Since (Si^{z) and 0 ^(z) are both non- 
negative real numbers, it is also clear, dropping first one and 
then the other of these quantities from the last equation, that* 

(1) \z\ ^ (R(2:) 

(2) |zl ^ g(z) 


• We must always keep in mind the fact that the complex numbers cannot be 
ordered and that greater than and less than have meaning only when applied 
to real numbers. 
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( 3 ) 

( 4 ) 

( 5 ) 

( 6 ) 

FIGURE 14.4 

The triangle 
inequality 
applied to com¬ 
plex numbers 

( 7 ) 


( 8 ) 

( 9 ) 


Moreover, from the definition of conjugate complex numbers, it 
follows that 

1*1 = 1*1 

and 

* ■ * = 1 * 1 * 

Also, from Eqs. (4) and (5), Sec 14.3, for the products and 
quotients of complex numbers expressed in polar form, it is 
clear that 


|*l*j| = |2l| • \Zi\ 

and 


Z2 



Z2 9 ^ 0 


Since the length of any side of a triangle must be equal to 
or less than the sum of the lengths of the other two sides, it fol¬ 
lows from the geometnc addition of complex numbers (Fig. 14 4a) 




\zi + Zi\ ^ \zi\ + 1 ^ 2 ! 

This can readily be extended to three terms, for 
Izi + Z 2 + Z3I = \Zl + (22 + 23)! 

^ \Zi\ + \Z 2 + 23 ] 

^ \zi\ + \Zi\ + \Zi\ 

The important extension to n terms is obvious: 

1 X *‘l ^ S 1**1 

*-1 *-i 

It IS also geometrically evident that the length of any side 
of a triangle must be at least as great as the difference of the 
lengths of the other two sides (Fig. 14.46). Hence, 

1*1 - *»| ^ I |*i| - kj| I ^ 0 

If it happens that | 2 i| is greater than or equal to I 22 I, the outer 
absolute-value signs on the right are, of course, unnecessary. 
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EXAMPLE 1 

Describe the region in the z-plane defined by the inequality (R(z) > 1 

If the real part of z is greater than 1, the image of z must be a point to the right of the line 
I - 1 Hence, the given inequality defines the set of all points in the half plane to the right of 
this line Since the equality sign is not included in the definition of the region, poinis actually on 
the line x — 1 do not belong to the region 


EXAMPLE 2 

What region in the z-plane is defined by \z — zo| ^ 9*^ 

In words, the given inequality asserts that the distanct' between the image point of z and 
the fixed point which is the image of zo is equal to or less than 9 This clearly defines the set of 
all points within and on the boundary of the circle of rad»\is 9 which lias the image of Zq as its 
center (Fig 14 6) In the work that lies ahead, we shall frequently have to consider regions of 
this type 


FIGURE 14.5 
The circular 
region 
|r - «o| ^ 9 



EXAMPLE 3 

If le = (z -f- i)/(iz -h 1), show that the restrietion S(z) S 0 implies the restriction |wj| S 1 

Kinee we are asked to establish a certain property of our first step is to compute this 
quantity This can be done m various ways, bur it is probably most convenient to construct the 
product 

z+i 

w iD ^ Irel* - ' r "_L 1 / 

iz + 1 \iz +1/ 

Since the conjugate of a quotient is the qu< tient of the conjugates, this can be written as 


\w\^ 


z -h t z -f t 
-h 1 tz + 1 


Moreover, the conjugate of a sum is the sum of the conjugates, hence we have further 

1 ,|i „ ^ ^ 

tz 1 iz I 

Finally, since i = ~i and ^ IS = —tS, we have 


I |I = / i-1 ^ ~ ^ ^ (zz + 1) — t( z -_S) 

iz d- 1 -tz -b 1 (z2 -b 1) -f i(z — S) 

^ 1 -i- 

” z5 -b 1 - 2^(z) 

Now, zf -f 1 IB a positive quantity Hence, it is clear that, if tf(z) ^ 0, as given, then the numera¬ 
tor of the last fraction is equal to or less than the denominator Thus [lel*, and, hence, lie], is at 
most equal to I under the given conditions 
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Since the restriction g 0 implies that z lies on or below the real axis in the plane in 
which z IS plotted and since \w\ ^ 1 implies that w lies on or inside the unit circle in the plane m 
which w is plotted, it follows that the given relation 

z + t 

w — ■:-;— 

tz -|- 1 

can be thought of as a transformation, or mapping, which sends the lower half of the z-plane, 
point by point, into the region consisting of the unit circle and its interior in the u^-plano Map¬ 
pings of this sort are of considerable importance in applied mathematics, and in Chap 17 we 
shall examine their properties in more detail 


1 
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6 
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EXERCISES 

If a and b are real, show that 


a lb 


6 -f la I 

Find |z|, ^R(z), and if z — [(3 4- 4t)(12 — 5i)J/2t 
Under what conditions will |zi + zt\ - lzi| + IZ2I? 


1 Is this true if a and b are not real? 


Show that 


z^_ 

zi + za 


Under what conditions will the equality sign hold*^ 


I l-.l - hi I _ 

Show that lx + iy\ ^ (jx! + \y\)/\^ 2 Under what conditions will the equality sign hold'^ 


Show that |zi — Zal’ + |zi + ZaP ■ 2|zi|* -|- 2 
Show that the locus of points for which ^ * 


2 aP 


' k, where /c i« a positive constant differenl 


h-Ml 

from 1, IS a circle What is the locus if A: »» 1? if A: — 0? if A- <0? 

What region in the z-plane is defined by the inequalities 0 < (R(z) ^ 9{z)'^ 

What region in the z-plane is defined by the inequality |z — 1] ^ CR(z)7 
If t/i — i(l — z)/(l + z), prove that < 1 implies 0{w) > 0 

Without using any properties of the polar representation of complex numbers, prove that 
|ziz,| - |zi| lzj| 

Prove algebraically that |zi 4- zal ^ |zi| 4- \zt\ [Hint Consider the identity jzi 4- 22!* = 
(zi 4- zi)(zi 4- z,) ] 

Prove algebraically that |zi — 2j| ^ | Izi| — |zj| | ^ 0 

Provo that, if 2 4- 1 /z is real, then either z is real or the absolute value of z is 1 
If zi, Zi, , Zn and tci, Wi, , Wn are complex numbers, prove that 

I 5] z.te. [ ^ |z.P J h.P 
t-1 1-1 t-1 

This result is sometimes known as Cauchy’s inequality [Hint. Consider the discriminant of 


the quadratic equation ^ (Iz.|X — lie.l)’ — 0 J 


14.5 

Functions of a complex variable 

If 2 = j -f- zt/ and w = u IV are two complex variables, and if. 
for each value of z in some portion of the complex plane, one or 
more values of w are defined, then w is said to be a function of z, 
and we write 

w = /(*) 



SfC. 14.5 


FUNCTIONS OF A COMFLIX VARIAIU 


445 


( 1 ) 


If tt; = /(z), that IS, if 
u iv = J{x + ly) 

it follows that the real numbers u and v are themselves determined 
by the real numbers x and y. Hence, the assertion that u; is a 
function of z = X -\- ty can also be written 

w = uix,y) -f w{x,y) 

where u(x,y) and v(x,y) are real-valued functions of the real 
variables x and y Clearly, whenever a value of z is given, values 
of x and y are thereby provided '^nd, thus, one or more values 
of w are determined by (1) For example, if 

w = f(z) = (x^ - y) ^ (x -\- y^)i 

and if 2 = 1 -h 2t, then a; - 1 and i/ = 2, and, thus, 

/(I -h 2i) - (V - 2 ) -h (1 -t 2 '^)i = -1 -h 5 z 

If w IS defined as a function of z m the form ( 1 ), it may be 
possible by suitable manipulations to rearrange the expression 
7 /(x,y) + tv{x,y) so that x and y occur only in the binomial 
combination x + iy For instance, 

w — {x^ — y^) -h 2 txy 

is immediately recognizable as 

le = (j -H lyy — 2* 


and 


w 


X 

+ y^ 


_jy _ 

-h y^ 


IS nothing but the standard complex form of 

1 1 

w = —^- = - 

X ly z 

On the other hand, it may be impossible to express w in a form 
involving only the explicit combination x -F iy without using 
such ^‘artificiar' expressions as 01(2) ^ x and d{z) = j/, with 
which, of course, any formula in x and y can be written in terms 
of z. For instance, unle&s we resort to "artificiar’ functions, no 
rearrangement of the formula 

w = 7x 3iy ^ 4CR(2) 3z = 7z — ^ia{z) = 5 z -h 22 

can reduce w to explicit dependence on z alone. In our work and, 
in fact, in most applications of complex variable theory, the 
only functions of interest will be those which can be written in 
terms of z alone, without recourse to z, ( 5 {(z), 0(z), and similar 
expressions. 

Frequently our interest in a function will be restricted to 
its behavior at the points of some specified part of the z-plane. 
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However, before we can undertake discussions of this sort, we 
must define and explain some of the simpler properties of tne 
sets of points we intend to consider 

By a neighborhood of a point zo we mean any set consisting 
of all the points which satisfy an inequality of the form 

1^ — 2o| < € € > 0 

Geometrically speaking, a neighborhood of zq thus consists of all 
the points within but not on a circle having zo as center A point 
Zo belonging to a set S is said to be an interior point of if there 
exists at least one neighborhood of zo whose points all belong to S 
A set each of whose points is an interior point is said to be open. 
A point Zo not belonging to a set S is said to be exterior to S if 
there exists at least one neighborhood of zo none of whose })oiiits 
belongs to S. Intermediate between points interior to S and 
points exterior to S are the boundary points of S A point zo ih 
said to be a boundary point of a set S if every neighborhood of 
Zo contains both points belonging to *S' and points not belonging to 
*S. The boundary points of a set may or may not belong to the 
set, depending upon its definition 

A point Zo is said to be a limit point of a set if every neighbor¬ 
hood of the poiiil contains at least one point of the set distinct 
from Zo A set which contains all its limit points is said to Ix' 
closed. Obviously, a set can be defined to contain some but not 
all of its limit points, hence it is clear that a set may be neither 
open nor closed 

If a set has the property that every [lair of its [)oinls can 
be joined by a polygonal arc whose points all belong to the set, 
it IS said to be connected. An open connected set is said to Ix^ a 
region or a domain. A set consist ing of a region together with all 
its limit points IS called a closed region. A connected set S with 
the property that every simple closed curve^ which can be drawn 
m its interior encloses only points of S is said to be simply con¬ 
nected. If it is possible to draw m S at least one simple closed 
curve whose interior contains jioints not belonging to S, then S 
said to be multiply connected. f If there exists a circle with center 
at the origin enclosing all the points of a set i e , if there exists 
a number d such that 

\z\ < d for all z in 5 

then S is said to be bounded. A set which is not bounded is said 
to be unbounded. The set consisting of the points between two 
concentric circles is called an annular region or a^i annulus. 


• See footnote to Theorem 1, Sec 12 4 

t In two dimensions the definitions of simply connected sets and multiply 
connected sets given at the end of Sec 12 5 are clearly equivalent to those 
of the present section. 
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FIGURE 14.6 

Typical regions 
m the complex 
plane. 


The preceding ideas are illustrated in Fig. 14.6a, where the 
three sets 

Si \z — Zq\ < Ti 

$2'. ri ^ \z - zo\ < ri 
r2 ^ \z — ^o| 



(a) (b) 


are shown The set iS^ consists of all points interior to the circle 
\z — zo\ = It IS bounded and simply connected Since points 
on the boundary circle \z - Zi)\ -= rj arc not included in the 
definition of Si. the .set l.^ open and is, therefore, a domain, in 
particular it is a neighborhood of The set S<i cons’sts of all the 
points in the annulus between the circl(\'. \z — .(j'ol - f'l and 
\z — zn\ = 7 2 plus the points on the inner houndarv of the annulus 
but not those on the outer boundary Since S-* thus contanc'. some 
but not all of its boundary points, it is neither open nor closed 
and IS, thereloie, neither a domain nor a closed region Clearly, 
there are closed curves in *^2, namely, any curve enrircliiig the 
inner boundary, which will enclose points not belonging to S2, 
namely, the points of Si Hence, S^ is multiply connected Obvi¬ 
ously, S‘2 IS bounded The .set Ss consists of all points on and out¬ 
side the circle |2 — Zo\ = / a It is, therefore, unboundod, cKised, 
and multiply connected According to oui definition, it i.s a closed 
region 

Because simply connected regions are in many respects 
easier to w'ork with than multiply connected regions, it is often 
desirable to be able to reduce the latter to the former This can 
always be done by modifying the given multiply connected region 
through the introduction of auxiliary boundary arcs, or crosscuts, 
joining boundary curves that were originally disconnected The 
effectiveness of this technique is illustrated in Fig. 14 66 , which 
show's a closed region originally multiply connected with one outer 
boundary curve C and two inner boundary curves C' and C" 
The introduction of the auxiliary boundary arcs A'B* and A"B" 
clearly makes it impossible to draw closed curves which lie 
entirely in the interior of the modified region and at the same 
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time encircle either of the inner boundaries C' and C". The modi¬ 
fied region is, therefore, simply connected, as required. 

It will often be necessary for us to consider the limit of a 
function of z as z approaches some particular value Zq. The basis 
for this is the following definition 

DEFINITION 1 

If /(z) IS a single-valued function of z and ico is a complex constant and if, for 
every e > 0, there exists a positive number 6(€) such that \f{z) — wq\ < e for all 
2 such that 0 < \z — Zq\ < 6, then uio is said to be the In it of/(2) as 2 approaches 2o 

In less technical terms, Wo is the limit of f(z) as z approaches zq 
provided that/(2) can be kept arbitrarily close to Wq by keeping 
2 sufficiently close to but distinct from Zo 


EXAMPLE 1 

If/(z) — (i -h yy/{x* + y*), show that 


lim [lim f{z)] “ 1 and lim [lim /(z)l = 1 

I —*0 V —>0 y —»0 T —*0 

but that lim f{z) does not exist 

f -»0 

Clearly, lim [lim/(z)] “ lim lim — „ y 

x—*0 v~*0 *—»0 I ir-»0 “h y® J X—+0 

[ (.X “h 1/) ® 1 

lim-« lim (1) “ 1 as asserted 

X—*0 2* “h y® J ]/—*o 


On the other hand, for lim f(z) to exist, it is necessary that/( 2 ) approach the same value alonp all 

*—»0 

paths leading to the origin, and this is not the case; for along the paths y = mj we have 


hm f(z) 

f -*0 


(x + y)* 
■0 X* + y 


(1 + m )» 
0 1 H- m 


(1 -h m )» 
'l + m* 


The limiting value here clearly depends on rn, that is, f(z) approaches different values along 
different radial lines, and hence no limit exists 

Closely associated with the concept of a limit is the concefit 

of continuity: 


DEFINITION 2 

The function /(x) is continuous at the point Zo provided that lim f(z) = f(zv) 

In other words, for a function to be continuous at a point zo, the 
function must have both a value at that point and a limit as z 
approaches that point, and the two must be equal If f(z) is con¬ 
tinuous at every point of a region, it is said to be continuous 
throughout the region. 

In addition to the fundamental theorems on limits we en¬ 
countered in calculus, there are various theorems on continuous 
functions which we shall need from time to time. For the most 
part these appear almost self-evident, although their proofs are 
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by no means triviaJ. We shaJl merely list them here, and refer to 
standard texts on advanced caJculus for their proof. * 


THEOREM 1 

Sums, differences, and products of continuous functions and quotients of con¬ 
tinuous functions, provided the divisor functions are different from zero, are 
continuous. 

THEOREM 2 

A continuous function of a continuous function is continuous. 

THEOREM 3 

A necessary and sufficient condition that 

/(z) = u{x,y) T iv{x,y) 

be continuous is that the real functions u{x,y) and v{x,y) bo continuou.s 

THEOREM 4 

Iff{z) i.s continuous at a point Zq and if/(- 2 o) ^ 0 , then there exists a neighborhood 
of ^o throughout which/(c) is different from 0 . 

THEOREM 5 

If /(z) continuous over a bounded, closed region R, then tliere exists a posit 
constant M such that l/(z)| < M for all values of z in H 

EXERCISES 

1 lf/(?) = xy + lix^ - v'), what i8/( - 1 + 2i)? 

2 If /(z) = r + (zj* -f S(zz), what is/(2 -|- i)? 

3 Express {2xy 2x — 1) — i{x^ — — 2y) as a polynomial in the binomial argument 

z ^ X 'ly 

4 Express x^ -f ly^ m terms of z and 5 

6 Desciibe each of the following sets of points, telling whether it is bounded or unbounded, 
open or closed, and simply or multiply connected 

a d{z) >0 b 2 ^ |z| ^ IS 

c U - 1| > 4 d 0 ^ (M(z) ^ 1 

e 0 ^ Mz) < (R(z) f |z* - \\ 

6 Show that lim ——^— does not exist 

7 Show that lini ——^— does not exist, even though this function approaches the same 

X* + i/^ 

limit along every straight line through the origin 

8 If f{z) ac / ^ ^y ^ show that lim [lim /(z)] and lim /(z) exist and are equal, 

M) V » 0 j,_0 x-*0 e—0 

but that lim [lim /(z)] does not exist 

X—>0 y—*0 

9 Prove Theorem 2 

10 Show that every neighborhood of a limit point of a set 5 contains infinitely many points of S 


* See, for instance, A E Taylor, "Advanced Calculus," pp 494-503, Gmn 
and Company, Boston, 1955 
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Analytic functions 


( 1 ) 


The derivative of a function of a complex variable w = f{z) is 
defined as 


dw 

dz 


w’ = r{z) = 


A«-»0 


This definition is formally identical with that for the derivative 
of a function of a real variable Moreover, since the general theory 
of limits IS phrased in terms of absolute values, it is valid for 
complex variables as well as for real variables Hence it is clear 
that formulas for the differentiation of functions of a real variable 
will have identical counterparts in the field of complex numbers 
when the corresponding functions of a complex variable are 
suitably defined In particular, such familiar formulas as 


d(wi ± W 2 ) _ dwi dw2 
dz dz ~~ dz 

diwxWi) dwi . dw\ 

— -1 - = Wv -h W2-J- 

dz dz dz 

d{w\/w2) _ W2{dw\fdz) — wxidwi/dz) 
dz W‘2^ 


d{w^) 

dz 


nw 


dz 


W 2 ^ 0 


are valid when Wi, W 2 , and w are differentiable functions of a com¬ 
plex variable z However, Az = Ax i is itself a complex vari¬ 
able, and the question of just how it is to approach zero involves 
difficulties which have no counterpart in the differentiation of 
functions of a real variable 

In Fig 14 7 , it IS clear that Az can approach zero; 1 e., that a 
point 

Q ‘ z Az 

can approach the point F:z, along infinitely many paths. In 


FIGURE 14 7 

Plot show mg 
various ways in 
which Az can 
approach zero 


A 



SfC. 14.6 


ANALYTIC FUNaiONS 


651 


particular, Q can approach P along the line AP on which Ax is 
zero or along the Une BP on which /\y is zero. Clearly, for the 
derivative of f(z) to exist, it is necessary that the limit of the difference 
quotient (1) he the same no mcUter how Az approaches zero How 
severe a restriction this is can be seen by considering the simple 
function 

w = f(z) ^ 2 = X — ly 

Giving to z the increment Az = Ax i Ay means that x 
changes by the amount Ax and y changes by the amount Ay 
Hence, 

/(z + Az) - f(z) ^ [ (x + Ax) - i(y A i/)] - (j — ly) ^ Ax - i Ay 

Az Ax -j- 2 Ay Ax -h 2 Ay 

Now, if Az IS real, so that Ay = 0 , we have 

, Ax — i Ay , Ax 
lim --;-- = lirn — = 1 

^0 ”r ^ Air—»0 

On the other hand, if Az is imaginary, so that Ax = 0, we have 

hnx = I.m = -1 

A*-»o Ax H" 2 Ay ^ Ay 

More generally, if we let Az —+ 0 m such a way that Ay = m Ax, 
we have 

Ax — i Ay , Ax -- 2772 Ax 1 — 2771 (1 — m^j — 22m 

lim ~ ■ . — lim ■" - - — r j — ^ I „ 

A^o Ax -f 2 Ay Ax + 2 m Ax 1 H- im 1 + yn^ 

Thus, there are infinitely many complex values which the differ¬ 
ence quotient for f{z) = x — ly can be made to approach by 
choosing properly the manner in which Az shall approach zero 
It IS, therefore, apparent that 2 = x — ly has no derivative 

That a function as simple as f(z) = x ~ ly should have no 
derivative seems at first glance a discouraging state of affairs. 
However, there are many functions of z which do have derivatives, 
and in applications it is these functions which are of importance. 
Our immediate task is to identify these functions by obtaining 
conditions for the existence of the derivative of a function of a 
complex variable. 

To do this, consider 

u; = /(z) = u{x,y) + w{x,y) 

By definition, 

dw Aw 

-j- = lim — 
uz Ac-»o Az 

^ 1 - [^(x -I- Ax, y -h Ay) -|- iv(x -f- Ax, y -h Ay)] — [u(x,y) -f 2t;(x,y)] 

^0 Ax + i Ay 

Ay —>0 


( 2 ) 
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( 4 ) 


( 6 a) 

(5fe) 


Now, if is real, i e., if Ay = 0 , we obtain 

^ = i,Tn y) + iv{x + Ax, y)] - [u{x,y) -f iv(xM 

dz Ax 

u{x + Ax, y) - u(z,y) v(x + Ax, y) - v{x,y) 

Ax Ax 

The two difference quotients which appear in the last expression 
are precisely those whose limits define the partial derivatives of 
u and V with respect to x. Hence, it appears that 


= lim 

Ax—>0 


dw 

dz 


du dv 
dx ^ dx 


On the other hand, if Az is imaginary, i.e , if Ax = 0 , we find 
from ( 2 ) that 

= lim y -t- Ay) + tv(x, y - 1 - Ay)] - [ u(x,y) -|- iv{x, y)] 

dz Av~»o t Ay 

= lim r y + Ay) ~ u{x,y) ^ d (x, y -f- Ay) - v {x,yy 
L i Ay 

_ I du ^ dv 
i dy dy 

or, finally, 

dw _ dv du 

dz dy dy 

Thus, if the derivative dwjdz is to exist, it is necessary that 
the two expressions we have just derived for it be the same. Hence, 
from ( 3 ) and ( 4 ), 

du dv _ dv du 

dx ^ dx dy ^ dy 


which requires that 

du _ dv 
dx dy 

du _ dv 
dy dx 


These two extremely important conditions, which are known 
as the Cauchy-Riemann equations,*^ have arisen here from a con¬ 
sideration of only two of the infinitely many ways m which Az 
can approach zero It is, therefore, natural to expect that severe 
additional conditions will be necessary to ensure that along these 
other paths Aw/Az will also approach the same limit dw/dz This 
is not the case, however, and it can be proved without great 


* After the French mathematician Augustin Louis Cauchy (1789-1857), 
and the German mathematician George Friedrich Bernhard Riemann (1826- 
1866) 
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difficulty* that, if u and v together with their first partial deriva¬ 
tives Ux, Uy, Vx, Vy are continuous in some neighborhood of the 
point 00, then the Cauchy-Riemann equations are not only neces¬ 
sary but also sufficient conditions for the existence of a derivative 
of w = u{x,y) -h iv{x,y) at 0 = Zo 

If w = f(z) possesses a derivative at z = zo and at every 
point in some neighborhood of zo, then f(z) is said to be analytic 
at Zo, and zo is called a regular point of the function If /(z) is not 
analytic at Zo, but if every neighborhood of Zo contains points at 
which f(z) IS analytic, then Zo is called a singular point of /(z) A 
function analytic at every point of a region R we shall call 
anal 3 rtic in R Although most writers use this term, a tf*w substi¬ 
tute such adjectives as regular and holomorphic. As a summary 
of our discussion we have the following theorem 


THEOREM 1 

If V and V are real single-valued functions of x and y which, with their four first 
partial derivatives, are continuous throughout a region R, then the Cauchy- 
Riemann equations 


du _ dv , du _ dv 

Jx ~ Jy ~ dx 

are both 1 cessary and sufficient conditions that/(z) = u(x,y) -h w{x,y) be analy¬ 
tic in R In this case the derivative of /(z) is given by either of the expressions 


/'W 


dx ^ dx 




EXAMPLE 1 

For uj ■» f — I — 1 ]/, we have u “ z and y * —y In thia case 

£-"=0 ££-o ££--1 

dx dy dx dy 

and, although the second of the Cauchy-Riemann equations is satisfied everywhere, the first is 
nowhere satisfied Hence, there is no point in the z-plane where dwjdz exists, which, of course, 
confirms our earlier investigation of this function 


EXAMPLE 2 


For w “ 2 i — I* -h 1 /*, we have u « i* + y* and 1 ; - 0 In this nose the partial derivatives 

0 


du 

— - 2x 
dx 


du 

-- = 2v 

dy 


dv ^ dv 
dx dy 


are continuous everywhere. However, the Cauchy-Riemann equations, which in this case are, 
respectively. 


2x - 0 and 2y ^ 0 

are satisfied only at the origin Hence, 2 - 0 is the only point at which dwjdz exists, and w - zl 
is nowhere analytic 


* See, for instance, Einar Hille, "Analytic Function Theory,” vol 1, pp 78- 
80, Gmn and Company, Boston, 1959 
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EXAMPLE 3 

For w — * (x* — y*) + 2ixy, we have 


du 


- 2i 





and the Cauchy-Iiiemann equations are identically satisfied Moreover, the first partial deriva¬ 
tives of u and v are everywhere continuous Hence, the derivative dwidz exists at all pointa of 
the z-planc, and its value from either (3) or (4) is 
dw 

— — 2x -h 2iy * 2z 
dz 

This, of course, is exactly what formal differentiation according to the power rule would give 


Analytic functions have a great many important properties, 
many of which we shall investigate m later sections. At this point 
we note only the following 


PROPERTY 1 

If both the real part and the imaginary part of an analytic function have con¬ 
tinuous second partial derivatives, then they satisfy Laplace’s equation 

a 

dx^ ^ dy^ 


PROOF Let w = u(x,y) -|- tv(T,y) be an analytic function of z Then u and v 

must satisfy the Cauchy-Riemann equations, namely, 

du dv , du dv 

T- — T- and T = — 

dx dy dy dx 


If we differentiate the first of these with respect to x and the second with respect 
to y and add the results, we obtain the first assertion of the theorem 


d^u _ dH 
dx^ dx dy 


d^u 

dr 


d^u dy, _ 

^ 


d^v 
dy dx 


The existence of the second partial derivatives and their continuity, which makes 
the order of differentiation in the cross partial derivatives immaterial, must here 
be assumed Later we shall show that an analytic function possesses not only a 
first derivative, but derivatives of all orders, which implies the existence and con¬ 
tinuity of all the partial derivatives of u and v. In exactly the same way it can be 
shown that v satisfies Laplace’s equation 


A function which possesses continuous second partial deriva¬ 
tives and satisfies Laplace's equation is usually called a harmonic 
function. Two harmonic functions u and v so related that u iv 
is an analytic function are called conjugate harmonic functions.'^ 
This use of the word conjugate must not be confused with its use 
in describing 2 , the complex number conjugate to z 


* The order in the pair (u,v) is important, as Exeroise 6 me' se clear. 
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property 2 

\iw = uixyn) -h w{x,y) is an analytic function of 2, then the curves of the family 
uix,y) = c are the orthogonal trajectories of the curves of the family v{x,y) = /c, 
and vice versa 

PROOF To prove this, we compute the slope of the general curve of each 
family by implicit differentiation, getting for the curves u(x,y) = c the expression 

(a\ ^ 

^ ^ dx du/dy 

and for the curves v(x,y) = A: the expression 
dx dv/dif 

By hypothesis, w — u iv an analytic function Hence, it follows from The¬ 
orem 1 that u and v satisfy the riauchy-Riemann equations Therefore, using these 
equations, the expression ( 7 ) for the slope of the general curve of the family 
v{x,y) = k can be rewritten 

dy _ dujdy 
dx duldx 

which, at any common point, is just the negative reciprocal of the slope of the 
general curve of the family u{i,y) = c, as given by p]q ( 6 ) This suffices to prove 
that the ^wo families of curves are orthogonal trajectories, as asserted 

PROPERTY 3 

If, in any analytic function k; = u(x,y) -h 2c(r,y), the variables x and ?/are r/placed 
by their equivalents 111 terms of z and z, namely, 

z H- z j 2 — z 

r = —^ and y = 

then w will appear as a function of z alone 

PROOF Although z and z are clearly dependent, since either is determined 
when the other is given, we can regard w, by virtue of the given substitutions, as 
formally a function of two new independent variables z and z To show that w 

depends only on z and does not involve z, it is sufficiinit to compute ^ and verify 

that it IS identically zero Now, 

dw _ d(u + tv) _ ^ t _L ^y\ ^ -I- A- 

dz ~ Tz ~ az ^ dz \djdz dy dz) ^ \dx dz dy dz) 

Moreover, from the equations expressing x and y in terms of 2 and I, we have 

dx _ 1 d?/ _L _ J 

Tl~ 2 'dz^ ~ 2i~' 2 

Hence, we can write 

-u 1 ^ 4. l(^ -i- 

di ~ \^ dx 2dy) ^ \2Jx 2^j) ~ 2 dy) 2 \aj/ ^ 

Since w, by hypothesis, is an analytic function, u and v satisfy the Cauchy- 
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Riemann equations, and, therefore, each of the quantities in parentheses in the 
last expression vanishes Thus ^ s 0 . Hence, w is independent of 2 , that is 
depends on x and y only through the combination z = x ly 

EXERCISES 

1 At what points doefl (z — 2)/[(z -f l)(z* + 1)] fail to be analytic? 

2 Show that at no point in the z-plane does the derivative of/(z) — (R(z) »■ j exist Does this 
contradict the fact that according to the rules of calculus dxfdx “ 1? Explain 

8 Where are the Cauchy-Riemann equations satisfied for the function /(z) — xi/® + 
Where does/'(z) exist? Where i8/(z) analytic? 

4 Verify by direct substitution that (R(z*) and fl(z*) satisfy Laplace’s equation 
B If u + w 18 an analytic function, under what conditions, if any, will v -f lu be analytic? 

6 If u and v are conjugate harmonic functions, show that v and — u as well as — i; and v arc 
also conjugate harmonic functions, but that v and u are not 

7 Show that the various values approached by the difference quotient of/(z) = 5 as Az —► 0 
along the lines y — mx all he on a circle 

6 Is the converse of Property 2 true? That is, if u(x,y) — c and v{x,y) “ k are orthogonal 
trajectories, is w iv necessarily an analytic function? 

9 Prove that, if /'(z) « 0, then /(z) is a constant 

10 If in the function /(z) — u -1- tw we take z in polar form, namely, 

z — r(cos (9 + i sin 0) 

show that the Cauchy-Riemann equations become 

du 1 dv d ^ 

dr r do dr r dO 

11 If tc 18 an analytic function of z -» r(co8 5 -1- t sm 9), show that 

dw dw sin 0 i cos 0 dw 

— — (cos (9 — 1 sin — —-- 

dz dr r do 

12 If/(z) IS an analytic function, show that 

18 If/(z) and/(z) are both analytic functions, show that/(z) is a constant 

14 If /(z) IB an analytic function for which w* + e* is a constant, show that/(z) is a constant 

16 Prove L’Kospital’s rule for analytic functions If /(z) and g{z) are analytic functions in a 

region containing to, if/(zo) “ “ 0, and if g'(zo) 9 ^ 0, then lim 


14.7 

Th« elementary functioni of z 

The exponential function c' is of fundamental importance, not 
only for its own sake, but also as a basis for defining all the other 
elementary functions. In its definition we seek t preserve as 
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( 1 ) 


( 2 ) 


(3) 

(4) 


(3) 


many of the characteristic properties of the real exponential func¬ 
tion c* as possible Specifically, we desire that 

a e* shall be single-valued and analytic 
b de*/dz = e* 

c e* shall reduce to when A\z) =0 
If we let 


e‘ — u -{- IV 


and recall from Eq ( 3 ), Sec 14 6 , that the derivative of an 
analytic function can be written in the form 


// / \ dw . Sv 


then, to satisfy condition b, we must have 


du , dv 

t -- = u -h IV 
dx dx 


Hence, equating real and imaginary parts. 


dv 

Tx ~ 

Now, Eq ( 2 ) will be satisfied if 
u = e^4>{y) 

where is any function of y Moreover, since c' is to be analytic 
(condition a), xi and v must satisfy the Cauchy-Riemann equa¬ 
tions, hence, using the second of these equations, Eq ( 3 ) can be 
written 


du 

Differentiating this with respect to y, we obtain 

d'^u _ dv 

dy^ dy 

or, replacing ^ ^ according to the first of the Cauchy- 

Riemann equations, 

d^u _ du 

dy^ dx 

Finally, using ( 2 ), this becomes 
d^u 

= —u 
dy^ 

which, on substituting u = from ( 4 ), reduces to 

or ^"(y) = -<*>(y) 
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This IS a simple linear differential equation whose solution 
can be written down at once: 

it>{y) = A cos 3 / + B sin 2 / 

Hence, from (4), 

u = e*<t>iy) = e*(A cos y B sin y) 
and, from ( 5 ), 

SU / 4 \ 

V = — = ”e*( —A sin ?/ -h B cos y) 

oy 

Therefore, from (1), 

e* = u w = e*[(A cos y B sin y) + i{A sin y — B cos ^)] 

If this IS to reduce to e* when ?/ = 0 , as required by condition c, 
we must have 

e* = e*(A — iB) 

which will be true if and only if A = 1 and B = 0 . 

Thus we have been led inevitably to the conclusion that ij 
there is a function of z satisfying the conditions a, b, and c, then 
it must be 

( 6 ) c* = = €="(003 y tsm y) 

That this expression does, indeed, meet our requirements can be 
checked immediately, hence, we adopt it as the definition of e' 
It IS important to note that the right-hand side of ((>) is in 
standard polar form Hence, 

mod e* s \€‘\ — and arg e‘ = y 

The possibility of writing any complex number in exponential 
form IS now apparent, for, applying ( 6 ), with x = 0 and y = B, 
we have 

( 7 ) cos d t sin e = 6 *® 
and thus 

(8) r(cos 6 i sin 6) = re'^ 

The fact that the angle, or argument, of a complex number is 
actually an exponent explains why the angles of complex numbers 
are added when the numbers are multiplied and subtracted when 
the numbers are divided, as we found in Sec 14 3 
From the relation 

= cos B i sin B 


and its obvious companion 

= cos (— ^) -h i sin (— 0) = cos B — i sin B 
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( 9 ) 

( 10 ) 


( 11 ) 

( 12 ) 

( 13 ) 

( 14 ) 


M* 


we obtain, by addition and subtraction, the so-called Euler 
formulas 


cos 9 = 




and 


am B - 


e‘* - 
2 i 


On the basis of these equations, we extend the definitions of the 
sine and cosine into the complex domain by the formulas 

gs. _|_ g-.a 


pit _ 


2i 

From these definitions it is easy to establish the validity of such 
familiar formulas as 

cos^ z -b sin^ z = 1 

cos (zi ± Z2) = cos Zi cos Z2 T sm zi sin Zi 
sin (zi ± Z2) = sin Zi cos Za ± cos Zi am zj 
d(cos z) 

-3- = ~ sin z 

dz 

d(sin z) 

— i -= cos z 

dz 

If we expand the exponentials in ( 9 ), we find 

gt(x-|-»v) _|_ g—t(x+»v) 

cos z = ^-2- 

e-'e'* -b e'e-*' 


e'^^fcos X i sin x) -H e*'(cos x — i sin x) 


= cos X - pr- l sin X -pr - 


or, using the usual definitions of the hyperbolic functions of real 
variables, 

cos z = cos (x + ty) = cos x cosh y — i sm x sinh y 
Similarly, it is easy to show that 
sin z = sin {x + ty) = sin x cosh y i cob x sinh y 
In particular, taking x = 0 in (11) and ( 12 ), we find 

cos ty = cosh y 
sin ly = i sinh y 


The remaining trigonometric functions of z are defined in terms 
of cos z and sm z by means of the usual identities. 
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EXAMPLE 1 

What is COB (1 -h 2t)7 

By direct use of (11) we have 

COB (1 + 2i) — cos 1 cosh 2 — 1 sin 1 sinh 2 

- (0 5403)(3 7622) - i(0 8415)(3 6269) 

- 2 033 - 3.052t 


EXAMPLE 2 

Prove that the only values of z for which sin z =» 0 are the real values z “ 0, ±ir, ±2Tr, 

From (12), sin z = am i cosh y + i cos x sinh y Hence, if am z is to vanish, it is necessary 
that simultaneously 

am X coah j/ “ 0 
cos X sinh 1 / *» 0 

Since y 13 a real number, it follows from the familiar properties of the hyperbolic cosine Hint 
coah 1/^1 Hence, the first of these equations can hold only if sin j = 0, that is, if 

J “ 0, ±T, ±27r, 

But for these values of x, cos x, being either 1 or — 1, can never vanish For the second equal ion 
to hold, it la therefore neceasary that sinh y = 0 Since y la real, the familiar properties of the 
hyperbolic ame can be invoked, leading to the conclusion that 

1/ - 0 

Hence, the only values of z for which am z = 0 are of the form 
z « n-jT 4- 0i = TiTT n = 0, ±1, ±2, 

The hyperlx)lic functions of z we define simply by extending 
the familiar definitions into the complex number field' 

( 15 ) cosh z = - - 

( 16 ) sinh z = -—^ 

By expanding the exponentials and re^grouping, as we did m 
deriving ( 11 ), we obtain without difficulty the formulas 

( 17 ) cosh z = cosh z cos y i smh x sin y 

( 18 ) smh z = sinh x cos y i cosh x sin y 

In particular, by setting x = 0 , we find 

( 19 ) cosh iy = cos y 

( 20 ) sinh ly = i sin y 

The remaining hyperbolic functions are defined from cosh z and 
sinh z via the usual identities 

The logarithm of z we define implicitly as the function 
ic = In which satisfies the equation 

( 21 ) = 2 
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If we let w = u w and z — Eq. ( 21 ) becomes 

gU-Hr = gugtr ^ 

Hence, e“ = r or u *= In r and v = B. Thus, 
w = u-\-w = \nr-\-iB 
( 22 ) ^ In \z\ -h i arg z 

If we let By be the principal argument of 2, i.e , the particular 
argument of z which lies in the interval — tt < J ^ tt, Eq ( 22 ) 
can be written 

( 22 a) In 2 = In |2| + i{di -j- 2 n 7 r) n =^' 0 , ± 1 , ± 2 , 

which shows that the logarithmic function is infinitely many- 
valued For any particular value of n, a unique branch of the 
function is determined, and the logarithm becomes effectively 
single-valued If n ~ 0 , the resulting branch of the logaiithmic 
function is called the principal value. Any particular branch of 
the logarithmic function is analytic, for, differentiating the 
definitive relation z ~ we have 



dw _ d(ln 2) _ 1 
dz dz z 

For a particular value of n the derivative of In z thus exists for 
all 2 5 *^ 0 

By means of ( 22 a) the familiar laws of logarithm^ which 
hold for real variables can be established for complex variables 
as well. For example, to show that 

In — = In 2i — In 22 
22 

let 2i = and 22 = 

where Bi and B2 are the principal arguments of Z\ and 22, respec¬ 
tively. Then, 

In 2i — In 22 = [In Vi + t{B\ -h 2 niir)] — [In r2 + 1(^2 "h 2 n 27 r)] 

= [In ri — In 7 ' 2 l + ^[(^l — ^2) + 2 (ni — n 2 ) 7 r] 

= In — — ^2) 27 i 3 Trl 

1'2 

1 21 , . Zi 

= In — t arg — 

Z2 ^2 

1 

= In — 

22 

General powers of 2 are defined by the formula 
( 23 ) = gain* 

which generalizes a familiar result for real variables which we 
frequently found useful m solving linear first-order differential 
equations Since In 2 is infinitely many-valued, so, too, is 2®, in 
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general Specifically, 

^ _ gfllnj ^ ^[In If l-HC^i+Snr)! — ^ Id If I^f,ig 2 nari 

The last factor in this product clearly involves infinitely many 
different values unless a is a rational number, say p/q; in which 
case, as we saw in our discussion of de Moivre’s theorem in Sec 
14.3, there are only g distinct values.* 


EXAMPLE 3 

What 18 the pnncipal value of (1 
By definition, 

(1 + l)>“' - e(*-0 1n(l-H) 

« g(2-i)[ln V2+»(.r/4 + 2nir)] 


The principal value of this, obtained by taking n -> 0, is 

g(2-0an V2+tr/4) „ g(21n >/2+ir/4)+i(-In V2+ir/2) 


I gin H-r/4 


j^COB - In \/2^ + i Bin (■^ - In V2^ j 


— ein«+w/<[ain (In \/2) -f i cos (In \/2)l 

- <7»»(8in 0 3466 + t cos 0 3466) 


- 1 490 + 4 126t 

The inverse trigonometric and hyperbolic functions we define 
implicitly. For instance, 

w = cos"^ z 

we define as the value or values of w which satisfy the equation 

giu. _j_ g-iu- 

Z — COS W = -Pi—— 


From this, by obvious steps, we obtain successively 

e2,w _ 2ze^'^ -1-1=0 

= 2 ± -v/ 2 ^ - 1 

and, finally, by taking logarithms and solving for w, 

(24) w = cos~^ 2 = —i\n{z±y/z^— 1) 

Since the logarithm is infinitely many-valued, so, too, is cos'^ z 
Similarly, we can obtain the formulas 

(25) Bin'^ 2 = z^) 

(26) tan"^ 2 = ^ In 

2 t — 2 

(27) cosh"^ 2 = In (2 ± V^ 2 * — 1) 

(28) sinh"^ 2 = In (2 ± \/ 2 * -f 1) 

(29) tanh-i z = ^ In 

Z 1 2 


• However, m the particular case r - e the expreseion ■ e® is single- 
valued for all values of a, rational or not, since e®r+*a, defined simply as 
e®r(co8 a» -H 1 Bin at), which is clearly a unique complex nur ber 
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From these, after their principal values have been suitably defined 
by choosing the positive square root and the principal value of 
the logarithm in each case, the usual differentiation formulas can 
be obtained without difficulty. 

EXERCISES 

Prove that cob* z -|- am* z — 1. 

Prove that cos (zi ± zj) — cos zi cos zi sin z\ sin z* 

Prove that sm (zi ± zi) — sin zi cos zj ± cos zi sin Z] 

Prove that d(cos z)/dz — — sin z 
Prove that d{R\n z)/dz » cos z 

Express each of the following m the form a -h tb, where a and b are decimal fractions* 

a sin (2 — i) b cosh (I H- i) c sinh (2 -1- 3t) 

d The principal value of In (~ 3 + 4i) 
e The principal value of (1 — 

Show that the various values of (I 4 t)*“' difft'r only in their lengths 
Prove that there is no value of z for which c* » 0 
If g{x,y) 18 a real function of x and y, what is 
Prove that ? * e* 

Prove that cos z = cos i 
Is In 2 = In z? 

Is sir* z <m am 2? 

Prove that the only zeros of cos z are the values ±ir/2, ±3ir/2, ±5ir/2, 

Find all solutions of the equation sin z « 3 
Find all solutions of the equation cosh z >» — 2 
Find all solutions of the equation c* =» —2 

By inspection, f" > 0 and e'^ < 0, yet by Exercise K there is no value of z for which e“ — 0 
even though c* is everywhere continuous Explain 

tShow that Rolle’s theorem fails to hold for the function — 1, even though the conditions 
of the theorem appear to be satisfied with respect to the two values z »» 0 and z “* 2ir. 
Explain 

Show that |sin zj* = sin* x + siiih* y and that jeoa zj* =» cos* x -h sinh® y What is Isinh zj*? 
What is Icosh z|*? 

If 2 =• X -b ly, show that Isinh y\ ^ |sin r| ^ cosh y. 

If z « X -(- 1 ^, show that jainh y\ ^ [cos zl ^ cosh y 
a If lz| ^ 1, show that jsin zj ^ %\A 
b Obtain an upper bound for [cos z\, given that lz| ^ I 
Show that sin z and cos z are not analytic functions of z 

_ , sm 2x + i smh 2y 

Prove that tan z -*-—— 

cos 2 j -b cosh 2y 


14.8 

Integration in the complex plane 

Line integrals in the complex plane are defined as follows: Let 
f{z) = u(x,y) -h iv{x,y) be any continuous function of z, analytic 
or not, and let C be a sectionally smooth arc joining the points A 
and B. Divide C into n subintervals by the points Zt {k = 1, 
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2, . . . , n — 1), and let Az* be the infinitesimal chord deter¬ 
mined by Aflfc Finally, in each subinterval choose an arbitrary 
point {■* = £* + ii)k (Fig. 14.8). Then, if it exists, the limit of the 
sum 


FIGURE 14.6 

The subdivision 
of an arc pre¬ 
paratory to the 
definition of a 
line integral 
in the complex 
plane 


( 1 ) 

as n becomes infinite in such a way that the length of each chord 
Az* approaches zero is called the line integral of f{z) along C: 

n 

( 2 ) /^/(Z)d2 = hm J/(f*)A2* 

Jfe-1 

In the special case when A and B coincide and C is a closed curve, 
the integral in (2) is often called a contour integral and is some¬ 
times represented by the symbol 

f}{z) dz 

In working with complex line integrals it is frequently nec¬ 
essary to establish bounds on their absolute values To do this, 
let us return to the definitive sum (1) and apply to it the funda¬ 
mental fact that the absolute value of a sum of complex numbers 
IS less than or equal to the sum of their absolute values [Eq. (8), 
Sec 14 4]. Then, 

IX /({•*) I ^ t = i 

ib-l *-l ib-1 

the last equality following from the fact that the absolute value 
of a product is equal to the product of the absolute values [Eq 
(5), Sec. 14.4]. As n—> oo^ this yields a corresponding inequality 
for the integrals which are the limits of the respective sums. 

/,/(*)*! g /,!/(*)11*1 



X /(fO Az* 

/b-1 


( 3 ) 
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The integral on the nght is the real line integral 

where ds is the differential of arc length on C, which of course 
exists since C is assumed to be sectionally smooth. In particular, 
if/( 2 ) = 1, we have the simple but important result 

(4) jf, \di\ = j^da = L 

where L is the length of the path of integration Since /(z) is 
assumed to be continuous on the path of integration, including 
the end points A and By it follows that/(z) is a bounded function 
of z on the path of integration; that is, that ttiere exists a constant 
M such that |/(z)| ^ M for all values of z on C Hence we have, 
from (3), 

I Siz) dz\^ |/(*)| \dz\ g M\dz\ = M \dz\ 

Therefore, using (4), we obtain the important inequality 


(5) 

1 dz \ g ML 

where M is any bound for |/(z)| on C, and L is the length of the 
path of integration 

(’omplex line integrals can readily be expressed in terms of 
real integrals For the sum (1) can be written 

n 

y !“({*,iio + 

n 

iv{^kjVk)](AXk -b 2 Aijk) = y [u(^k,Vk) Ax* — v{ik,Vk) Ay*] 

k~\ 

*-1 

n 

fc-1 

and, in the limit, the last expression yields the relation 

(6) 

f{z) dz = j^u dx — V dy t j^v dx u dy 

= (w + w)(dx -h i dy) 

From (6) and the known properties of real line integrals (Sec. 
12 4) or directly from (he definition (2), it is easy to see that, 
when the same path of integration is used in each integral, we 
have 

(7) 

fiz) dz = - 1* f(z) dz 

(8) 

kf(.z) dz = k f(z) dz 

(9) 

[/(z) + (7(z)l dz = /(z) dz ± p(z) dz 

and, if P is a third point on the arc AB, 

(10) 

f{z) dz = f{z) dz + fiz) dz 
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EXAMPLE 1 

If C iB a circle of radius r and center 2oi and if n is an integer, what is the value of 


f —^— 

Jc (z — 


For convenience, let us make the substitution z — zo “ re**, noting that 0 ranges from 0 t 
2 t as z ranges around the circle C (Fig 14.9) Then dz ~ rte** dS, and the integral becomes 



This 18 an important result to which we shall have occasion to refer from time to time 

The form of the real line integrals in (6) suggests that Green’s 
lemma (Theorem 1, Sec. 12.4) and the related results in Theorems 
5 and 6, Sec. 12 5, may be useful in studying line integration in 
the complex plane, and this is indeed the case Hence, for ease of 
reference, we repeat this important material, appropriately 
specialized to the two-dimensional applications we now have in 
mind:* 


THEOREM 1 

If R is a region, either simply or multiply connected, whose boundary C is sec- 

d P SQ 

tionally smooth and if P{x,y), Q(x,y), and are continuous in and on the 


* To avoid confusion with u and v in the standard notation for a function of 
a complex variable, namely, /(z) — u -h w, we here use P and Q in place of 
the symbols U and V we ui^ in Chap 12. 



5fC. M.i 


INTEGRATION IN THE COMPLEX PLANE 


A6P 


boundary of Ry then 

I^Pdx + Qdy= ff^^^-^Jdxdy 

where the integration is taken around C in the positive direction with respect to 
the interior of R. 


THEOREM 2 

In any region where iP(x,y) dx + Q(x,y) dy is independent of the path, the 
partial derivatives of the function 

P(x,y} dx + Q(x,y) dy 

are ^ = P(x,y) and = Q{x,y) 


THEOREM 3 

dQ dP 

If at all points of a simply connected region R, then in R the integral 

SPix,y) dx + Q{x,y) dy 
IS independent of the path, and conversely 


As a first application of Green's lemma, we have Cauchy's 
theorem, perhaps the most fundamental and far-reaching result 
in the theory of analytic functions 


THEOREM 4 

If ft IS a region, either simply or multiply connected, whose boundary C is sec- 
tionally smooth and if f(z) is analytic and/'(z) is continuous within and on the 
boundary of ft, then 

f(z) dz = 0 

PROOF We begin by recalling from Eq (6) that 

f{z) dz = u dx — V dy i j^v dx u dy 
Now the hypothesis that f\z) is continuous means that the partial derivatives 
Jx' ^ continuous throughout ft Hence, Green's lemma can 

be applied to each of the line integrals on the right of the last expression, giving 

- //.(- S - 

However, u and v necessarily satisfy the Cauchy-Riemann equations, since, by 
hypothesis, f{z) is analytic. Therefore, the integrand of each of the double integrals 
vanishes identically in ft, leaving 

fc fix) dz = 0 


as asserted. 
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The last theorem can be proved without making use of the 
hypothesis that f'(z) is continuous * The French mathematician 
Edouard Goursat (18r)8-1936) was the first to do this, and in his 
honor the more general form of the result is usually referred to as 

the Cauchy-Goursat theorem. 


FIGURE 14 10 

Contours which 
ran he con¬ 
tinuously 
deformed into 
each other 

(a) ib) 

In particular, if f{z) is analytic in and on the boundary of the 
region R between two simple closed curves, wo hav^e, from the 
Cauchy-Goursat theoicm, 

/(z) dz -h J{z) dz - 0 

provided that each curve is liavoised in tin* positive direction, as 
showui in Fig Id lOa On the otlier hand, if we reverse the direc¬ 
tion of integration •»round the inner curve and tianspose tfic 
resultant inU^gral, we obtain 

/(«) dz = S{z) (h 

each integral ion now being perfonned in the counterclockwise 
sense, as shown in Fig 14 106 Since there may be points in I he 
interior of (which, of course, is not a part of R) where f{z) is 
not analytic, we cannot asscit that eitliio' of these integials is 
zero However, w(‘ have shown that they both have llu' same 
value This result can be summarized in the higlily important 
principle of the deformation of contours: 



THEOREM 5 

The line integral of an aiialytu function around any closed curve Ci is ec^uaJ to the 
line integral of the same function around any other closed curve into wdiich 
Cl can be continuously deformed without passing through a point where j(z) is 
nonanalytic 

U f{z) IS analytic throughout a simply connected region R, 
then, according to the Cauchy-Cioursat theorem, 

/p f{z) dz = 0 

for every simple closed curve C in R, But, as wo saw m the dis¬ 
cussion which led to Theorem 6, 8ec. 12 o, this implies that the 


• See, for example, K G Philh|)8, “Functione of a Complex Variable,” pp 
89-92, Interscience Publishers, Inc , New York, 1945 
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line integral of f{z) between any two pojnts A and B in R is 
independent of the path. On the other hand, in multiply connected 
regions this observation is not necessarily true, since two different 
paths joining A and B might form a closed path encoding one of 
the inner boundaries of R and there is no assurance that the 
integral of f{z) around such a path is zero Thus, summarizing, 
we have the following theorem: 


THEOREM 6 

In any simply connected region where f( 2 ) is analytic, th( integral ff(z) dz is 
independent of the path 

Using Theorems 2 and 3 we can establish the following inter¬ 
esting result 


THEOREM 7 

If u(x,y) is a solution of Laplace’s equation in a region R, then in R there exists 
an analytic function having u as its real part, namely,/(e) = w + w, where 

/ \ dw j , da , 

= L - + 

and the path of integration from (a,6) to (x^y) lies entirely in R. 


PROOr Suppose first that R is simply connected Then in R the integral 
defining v is independent of the path between the arbitrary fixed point (ajj) and 
the variable point {x,y), since t he condition foi independence provided by Theorem 
3 is in this case 


dx dy dx^ dy^ 

which IS true because of the hypothesis that. satishes Laplace’s equation. The¬ 
orem 2 can, therefore, be applied to the integral which defines v, and we have 


dv 

dx 


du 

h 


and 


dv 


du 

dx 


These are precisely the Cauchy-Riemann equations, which, if the derivatives are 
continuous, are the conditions that/( 2 ) = u tv be an analytic function But 

^ and f and hence and — to which these are respectively equal, must 
dx dv dy dx 

d^u d^u 

be continuous, since the second partial derivatives and are known to exist. 

Hence, if R is simply connected,/(z) = u w ]s analytic, as asserted 

On the other hand, if R is multiply connected, then, by the principle of fhe 
deformation of contours, the possible values of v differ at most by constants 
independent of the end points And, clearly, a constant added to v will not affect 
the arialyticity of m + n; This completes the proof of the theorem. 


One of the most important consequences of Cauchy’s theo¬ 
rem is what 18 known as Cauchy’s integral formula; 
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THEOREM 8 

If f{z) is analytic within and on the boundary C of a simply connected region R 
whose boundary C is sectionally smooth and if zo is any point in the interior of /2, 
then 



the integration around C being taken in the positive sense. 

PROOF Let Co be a circle with center at Zq and radius p small enough so that 
Co lies entirely in R (Fig. 14.11). Now, by hypothesis,/(z) is analytic everywhere 


NGURE 14.11 
The circle Co 
used in the proof 
of Cauchy’s 
integral formula 



within R Hence, the function f{z)/{z — zo) is analytic everywhere within R 
except at the one point z = zo. In particular, it is analytic everywhere in the region 
R' between C and Co Hence, by Theorem 5, the integral of this function around 
C is equal to its integral around Co. That is. 


f J(^L dz = f dz= n 

JC Z — Zq JCo Z — Zo JCo 




f{^o) + [/(*) - /(^o)] 


z — Zo 


dz 


(11) 


= I m^JMdz 

Jco Z — Zo Jco Z — Zo 


By Example 1, the first integral on the right is equal to 2Tn Hence, the assertion 
of the theorem will be established if we can show that the last integral vanishes 
To do this, we observe that 


( 12 ) 


f f{z) - /(^o) 

Jco Z — Zo 


dz 


g f l/(^) 

Jcf, \z — Zo| 


\dz\ 


On Co we have \z — zo| = p Moreover, since f(z) is analytic and hence continuous, 
it follows that, for any € > 0, there exists a 6 such that 


|/(z) — /(zo)| < € provided \z — Zo\ ^ p < 6 


Choosing the radius p to be less than 6 and inserting these estimates in the right 
member of (12), we therefore have 


f ^)-fM .dz < nidzl = ‘ f \dz\ = -'2,P = 
JCt Z Zo p p JCt p 


Since the integral on the left is independent of«, yet cannot exceed 2Tre, which can 
be made arbitrarily small, it follows that the absolute value of th integral, and 
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hence the integral itself, is zero. Thus, (11) reduces to 

fiz) 


whence, 


■-/(2o)2irz + 0 

/(Zo) = ^ L dz 

2in JCq z — zq 


as asserted Cauchy’s integral formula is also true for multiply connected regions, 
but we shall leave as an exercise the easy modification of our proof required to 
establish this fact 


EXAMPLE 2 


Find the values of / ■ ■ ' dz if C la a rircle of unit rsidiuH with renter at (a) z — t and 

JC 2* -1- 1 


(b) z - -t. 

In (a) we think of the mtCKral as written in the form 
f e* dz 

Jc z -Y t z — I 

and identify Zo as i and/(z) as e^/{z -f- t) The function/(z) is analytic everywhere within and on 
the Riven circle of unit radius around z “ i (In fad , it is analytic everywhere except at z — — i ) 
Therefore, we can apply Cauchy’s integral formula, getting 

dz 


/. 


■“ 2m — “ 7r(co8 1 4- t sin 1) 

C 2 + T z - I 2i 

In {hj we identify Zo as and /(z) as e*/{z — i) Then Cauchy's integral formula gives 
immediately 


/c 


dz 


- 

C z — l 2 H- t 


27rl- »»» —7r(c08 1 — i Sin 1) 

— 2t 


From Cauchy's mtegral formula, which expresses the value 
of an analytic function at an interior point of a region R in terms 
of its values on the boundary of the region, we can readily obtain 
an expression for the derivative of a function at an interior point 
of R in terms of the boundary values of the function. In fact we 
have 


/'(2o) = lim 

Aio —>0 


/(z q + Azq) - /(^) 
Azo 


Azo jc Z — (zo + Azo) 2iri jc z — zq \ 

~ Az^ [2irt (z — (zo + Azo) Z - 

= hm — f /(g) 

2iri Jc (z — Zo — Azo) {z — Zq) 

Taking for granted that the limit of the integral is equal to the 
integral of the limit m the last expression and letting Azo —^ 0 in 
the integrand, we obtain the desired result. 

r Kz)dz 


1 
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That the limiting procedure is legitimate in this CEwe can easily 
be established by showing that the absolute value of the difference 

1 f _ f(z) dz _ r f{z) dz 

2iri Jc (z — Zq — Azo)(z — Zq) 2iri Jc {z — zo)* 

approaches zero as Azo —> 0 

Continuing in the same way, we obtain the additional 
formulas 


f///- \ f /(^) 

^ Jc (T -— 


(i - zoY 


- a /<■ 


(2 - Zo)* 


These results could all have been obtained formally by repeated 
differentiation of Cauchy’s integral formula with respect to the 
parameter Zq 

From the preceding discussion we conclude not only that an 
analytic function possesses derivatives of all orders but also that 
each derivative is itself analytic, since it, too, possesses a deriva¬ 
tive. This completes the proof of the following theorem 


THEOREM 9 

If f{z) is analytic throughout a closed, simply connected region then, at any 
interior point Zq of R, the derivatives of/( 2 ) of all orders exist and arc analytic 
Moreover, 

^ ^ 2 Tt Jc (2 - 2„)»-t > 

where C is the boundary of R. 

It is interesting to note that functions of a real variable do 
not in general possess the derivative properties described by 
Theorem 9, for, at particular points, a function of a real variable 
may possess one or more derivatives without the derivatives of 
all orders existing For instance, at the origin the function 
possesses a first and a second derivative but no derivatives of 
higher order. 

Using Theorem 9, we can now prove the converse of Cauchy’s 
theorem, which is known as Morera’s theorem :* 

THEOREM 10 

If /(z) is continuous in a region R and if dz = 0 for every simple closed 

curve C which can be drawn in R, then/(z) is analytic in R 

PROOF To prove this, we observe, as in the proof of Theorem 6, Sec 125, that, 
if the line integral of f{z) around every closed curve in R is zero, then the line 
integral of/( 2 ) between a fixed point Zo and a variable point z in /2 is independent 


Named for the Italian mathematician Giacinto Morera ( 856-1909). 
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of tlie path and, hence, ivS a function of z alone, say 

= f^mdz 

J *0 

If we lei/( 2 ) = w + IV and F{z) = U -{- iV, this can be written 

F{z) — U iV -- f u dx — V dy 2 f v dx u dy 

Jxt,vo ^ 

or, equating real and imaginary parts, 

U = I ^ udx — V dy and K = I v dx u dy 

J x^,Vo ^ J xtt.yo ^ 

By Tlieorem 2, each of these integrals can he difTcreioiated partially with respect 
to X and y, and we find 

dU dU dV dV 

~ = u ~ V — i; - - = u 

dx dy Sx dy 

From these it is obvious that 

dx dy dy dx 

or, in other words, that U and F, satisfy the Cauchy-Kicinann etjualions More¬ 
over, since u and v are continuous, because of the hypotliesis that./(^) ^ u 2V 

dL^ dU dV dl^ 

IS continuous, it follows that - - ’ are continuous Hence, F(z) = U -F tV 

dx dy dx dy > v / < 

IS an ai lytic function whose derivative, in fact, is 

"'w-f+ 4; 

Being the derivative of an analytic function,/( 2 ;) is therefore analytic, by Theorem 
t), as assert.ed 

Beginning wnth the formula for/^”^(2o) provided by Theorem 
9, we can now' establish what is known as Cauchy’s inequality; 

THEOREM 11 

If Kz) IS analytic within and on a circle of radius r with center at Zo, then 

w'here M is the maximum value of \fiz)\ on C 
PROOF From Theorem 9, we have 

M ^ I f 


\2m Jc {z - z„r*'\ 

^ ^ f l/(^)l \dA 

- 2ir Jc \z - Zol"-' ‘ 


^ n! M r y. 

= 27r 


n\ Jl , 
2^ ■ 
n\M 


as asserted 
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For the special case n = 0 , Cauchy’s inequality becomes 

l/(2o)| ^ M 

which shows that, on every circle around zo, no matter how small, 
l/(e)l has a maximum value M which is at least as great as/(2o) 
In other words, we have the following result, usually referred to 
as the maximum modulus theorem: 

THEOREM 12 

The absolute value of a function/(2) cannot have a maximum at any point where 
the function is analytic. 


r 3+1 

1 Evaluate / dz, (a) along the line y — x/3, (b) along the real axis to 3 and then verti¬ 

cally to 3 4- t, and (c) along the imaginary axis to t and then horizontally to 3 4- t 

r3 + t 

2 Evaluate / (i)*dz along each of the paths used in Exercise 1 

/" 14 • 

5 Evaluate / (i® 4- ty) dz along the paths y x and y 

i Obtain an upper bound for the absolute value of the integral ^ dz, (a) along y x, 

(b) along y - x>, and (c) along the real axis to 1 and then vertically to 1 4- t 

ire** 

6 Obtain an upper bound for the absolute value of the integral — / - dz taken around 

2x1 y 2* 4- 1 


7 What IS the value of 


dz, (a) if (7 18 the circle |z 4- 1 1 “1? (b) if C is the 


: dz (a) if C is the circle jzj = 1? (b) if C is the circle 


the circle \z\ “ 3 What is the value of this integral if the path of integration is the circle 
1^1 - 

/■ 3z2 4- 72 4- 1 

6 What 16 the value of /- dz, (a) if (7 is the circle Iz 4- 11 “1? (b) if C is the 

yc 2 4-1 1^1 

ellipse X* 4- 2y* “ 8? (c) if C is the circle |z 4“ i| = 1? 
f 2 4" 4 

7 What IS the value of / - dz (a) if C is the circle jzj = 1? (b) if C is the circle 

yc 2* 4" 22 4" 5 

|z 4- 1 — il ■■ 2? (c) if C IB the circle |z 4- 1 4- i| “2? 

/ €* 

- -- dz around the circle \z — 1| — 3? 

(z 4- 1)* 

9 What IS the value of f ^ dz, (a) around the circle jz] *» 17 (b) around the circle 

J z* — 2z* 

|z — 2 — ij — 2^ and (c) around the circle |z — 1 — 2i| = 2? 

10 Show that Cauchy’s integral formula is valid in multiply connected regions 
11 If u{x,y) IB harmonic, i e., satisfies Laplace’s equation, within the closed region bounded by 
a circle C, prove that the maximum value of ii{x,y) in R always occurs on C and not in the 
interior of R [Hint Apply the maximum modulus theorem to the function where/(z) 
IB the analytic function having u(x,y) as its real part ] 

12 Using Theorem 9, show that 


L" _ _L /■ i!l ,, 

nl 2x1 Jc 2 "+i 


where C is any simple closed curve encircling the origin 
18 Observing that the result of Exercise 12 can be written 
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prove 


that 




n-O 

14 Complete the proof of Theorem 9 by showing that the absolute value of the difiference (13) 
approaches sero as Azo approaches aero. 

16 a Taking C to be the circle defined by a ■« Re*^ and letting ao * (r < R), show that 
Cauchy’s integral formula becomes 

b Show alao that 


Re.* 


c Finally, by subtracting these two integrals and equating real parts in the resulting 
equation, obtain Poisson's formula: 

1 /•2r 


(R* - T*)u(R,e) 



CHAPTER FIFTEEN 


Infinite Series 
in the 

Complex Plane 


15.1 

Series of complex terms 

Most of the definitions and theorems rolatinp; to infinite senes of 
real terms can be applied with little or no change to series whose 
terms are complex To restate these briefly, let 

(1) /l(2) -h f2{z) -P ‘ + fn{z) -P 

be a senes whose terms are functions of the complex variable z 
Then the partial sums of this senes are defined as the finite sums 

S,{z) 

S2(z) +/ 2 W 

Sn(z) ^f,{z) +f,{z) -f • - 

The series (1) is said to converge to the sum S(z) m a region R 
provided that, for all values of z in R, the limit of the nth partial 
sum 5 ^( 2 ) as n becomes infinite is S{z) 

According to the technical definition of a limit, this requires 
that, for any c > 0, there should exist an integer N, depending 111 
general on e and on the particular value of z under consideration, 
such that 

\S{z) - Sn{z)\ < € for all n > N 

The difTerence <S( 2 ) — Sn{z) is evidently just the remainder after 
n terms Rn{z), thus, the definition of convergence requires that 
the limit of |i2n(2)|, as n becomes infinite, should be zero A senes 
which has a sum, as just defined, is said to be convergent, and the 
set of all values of z for which it converges is called the region of 
convergence of the series. A series which is not convergent is said 
to be divergent. If the absolute values of the terms in (1) form a 
convergent series 

1/1(2)! + 1/2(2)! + !/ 8 ( 2 )! + • * ■ + !/«(«)! + • 
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then ( 1 ) IS said to be absolutely convergent. If the series ( 1 ) con¬ 
verges but is not absolutely convergent, it is said to be condi¬ 
tionally convergent. Absolute convergence is an important 
property because it is a sufficient though not necessary condition 
for ordinary convergence Moreover, the terms of an absolutely 
convergent senes can be rearranged in any manner whatsoever 
without affecting the sum of the senes, whereas rearranging the 
terms of a conditionally convergent senes ma'’^ alter the sum of 
the senes or even cause (he senes to diverge. From the definition 
of convergence it i.s easy to prove the following theorem, 


THEOREM 1 

A necessary and sufficient condition (hat the senes of complex terms 

/l(2) +f2iz) + -hMz) + • ' • 

converge is that the .series of the real part.s and the series of the imaginary parts of 
these terms each converge. Moreover, if 

f (R(/„) and i S(/„) 

n B 1 n ™ 1 

converge to the respective functions R{z) and I{z), then the given .senes converges 
to R{z) -h tliz) 

Of all the tests for the convergence of infinite series, the most 
useful is probably the familiar ratio test, which applies to series 
whose terms are (complex as well as to senes whose terms .are real 


THEOREM 2 

For the senes 


fiiz) -\-Mz) +h{z) -h -H • 


let 


lim 

n—»w 


fn + l{z) 
, fn{z) 




Then the given series converges ab.solutely for those values of z for which 0 ^ 
|r( 2 )| < 1 and diverges for tho.se value.s of z for which lr(z)| > 1. The values of z 
for which |r(z)| = 1 form the boundary of the region of convergence of the senes, 
and at these points the ratio test provides no information aboui the convergence 
or divergence of the series. 


EXAMPLE 1 

Find the region of convergence of the Beriee 


1 + 




Applying the ratio test, we find 


Mz) 

\ 



n* z + 1 

fM 




(n -h D* z - 1 
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As n becomes infinite, this ratio approaches 


z + 1 


z — 1 


. Hence, the values of * for which the senea 


surely converges are those in the region defined by the inequality 
I z + 1 I 


< 1 


that 18 , by 


z-l| 

|z H- 1| < |z - 1| 


Now |z -h Ij is just the distance from z to the point — 1, and |z — 1| is just the distance from z to 
the point 1 Hence, z is restricted to be nearer to the point — 1 than to the point 1 In other 
words, z must lie in the left half of the complex plane The boundary cases for which the test fails 
are the values of z which are equidistant from — 1 and 1, that is, the values of z on the imaginary 
axis But, for these points, the related series of absolute values is the convergent real senes 


1 1 1 


Hence, for all values of z on the imaginary axis, the given senes, being absolutely convergent, is 
convergent, therefore, these points also belong to the region of convergence 

The sum or difference of two convergent series can be found 
by term-by-term addition or subtraction of the series. If two 
series converge absolutely, their product can be found by multi¬ 
plying the senes together as though they were polynomials To 
establish conditions under which series can legitimately be inte¬ 
grated or differentiated term by term, however, the concept of 
uniform convergence is required 


DEFINITION 1 

A senes of functions is said to converge uniformly to the function S{z) in a region 
R, either open or closed, if corresponding to an arbitrary € > 0 there exists a 
positive integer N, depending on t but not on z, such that for every value of z in R 

|>S(z) - Sniz)\ < € for all n > N 

In other words, if a series converges uniformly in a region R, then, 
corresponding to any e > 0, there exists an integer N such that 
everywhere in R the sum of the series S{z) can be approximated 
with an error less than e by using no more than N terms of the 
series. It may well be that fewer than N terms will suffice at 
most of the points of the region, but nowhere will more than N 
be required This is in sharp contrast to ordinary convergence, 
for, in the neighborhood of certain points in a region of ordinary 
convergence, it may be that no limit can be set on the number 
of terms required to secure a prescribed degree of accuracy. 


EXAMPLE 2 

Discuss the convergence of the series 


z* + 


l-h Z* (1 + Z«)« (1 -b z*)» 


in the 90® sector bounded by the right halves of the lines y — ±x (Fig 16.Ir 
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figure 15.1 

A 90“ sector 
before and after 
modification 
to exclude its 
vertex 


The given series is a geometric progression which will converge for all values of z for which 
the absolute value of the common ratio, i c , 


kl 


1 _ 

U 


is less than 1. Now the angle of 2 is restricted, by hypothesis, to be between —7r/4 and ir/4, hence, 
the angle of 2 * must be between —ir/2 and 7r/2 Therefore (Fig 15 16), for every z in the given 
region R, we have 

|1 + .«| S 1 and g 1 

and the equality signs hold only for the value 2=0 Thus, the given senes converges for all 
values of 2 in R, and its sum is 


+ 2* 2 0 


,S(2) = \ - r 1 - 1/(1 + 2*) 

0 + 0 + 0 + 0 + =0 2-0 

Now let an arbitrary c > 0 be given, and let us attempt to determine how many terms of the 
scries must be taken in order that 

15(2) - 5„(2)| < « 

This difference, 1 e , the remainder after n terms of the senes, is just the geometric progression 


T-. + 


whose f 


(1 + 2 *)" ’ (1 + 2 ^)"+' ’ (1 + 
1 


+ 


Rn(z) 


(1 + 
0 


Z 

z = 0 


Hence, our task is to find, if possible, a value of N such that 


( 2 ) 


|/ 2 „( 2 )| . — - < t for all n > N and all z in R 


Now |1 + 2*1 ^ 1 + |z*| = 1 + I 2 I* Hence, overestimating the denominator of 1/?„(2)1, we hav^ 

1 _ 1 _ 

From this inequality we observe that if it should be impossible to find an integer N such that 
(3) 1 


(1 + |r|*)”-‘ 


“ < « for all n > N and all z in R 



680 


INFINITE SERIES IN THE COMPLEX PLANE 


CHAP 15 


then surely it will be impossible to find an integer N which will suffice to keep 

|/?n(2)| < « 

everywhere in R And this la indeed the case, for if we attempt to solve the inequality (3) for n, 
by obvious steps we find 

(1 + kl*)"-' > - 

e 

(n — 1) In (1 -b |z|®) > In - - — In e 

c 

In e 

^ “ In (1 + kin 

But, for values of z within the sector of the problem and sufficiently close to the 01 igm, In (1 4 \z\^) 
can be made arbitrarily close to In 1, that is, zero Hence, /i is unbounded, and there exists no 
integer N for which (3) holds Since |/f„(2)| ih larger than the fraction in (3), it is clear that (he 
fundamental requirement of uniform convergence (2) cannot be fulfilled Hence, the eonvergenr c 
of the given senes in the original region is nonuniform 

On the other hand, if we reLtnct z to the infinite region R', bounded by the given rays and n 
circular arc of small but fixed radius 5, as shown in Fig 15 Ic, the senes converges uniformly In 
fact, the law of cosines applied to Fig 15 15 gives 

|1 4- 2s|2 = 1 -}- |22|2 ^ 2 |z*| cos (arg z®) 

or, reducing the right-hand side by dropping the last term, which is surely nonnegative, since 
-t/2 ^ arg z* ^ Tr/2, 

|1 4 2*1* ^ 1 + |z*|» » 1 + |z^| 

Hence, underestimating the denominator of |/('n(z)|, we can write 

From this it is clear that, if we can find an integer N such that 


(4) 


--- --< e for all n > and all z in R' 

(1 + 


then surely for the same N we shall have 

(5) |/?n(2)| < e for all n > and all z in R' 

Hence, we attempt to solve the inequality in (4) for n 


(1 + ki')'"'”'* > - 

c 

I^I‘) > In - = — In e 
2 In c 

^ ^ ^ In (1 + \z\*) 

The most unfavorable cose, i e , the largest possible value of the fraction on the right, occurs 
when |z| is os small as possible But, in the modified region we are now considering, the smallewt 
possible value of |z| is 5 , which yields 

2 In c 


n > 1 - 


In (1 -b «*) 
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If we ehooee N to be the first integer equal to or greater than the expression on the right, then 
(4) will surely hold But, as we observed above, if (4) is satisfied, so too is (5), and, heiiee, in the 
modified region R' the given senee converges uniformly 

Usually uniform convergence is established not by a direi't 
application of the definition, as in Example 2, but by the so-called 

Weierstrass M test:* 


theorem 3 

If a sequence of positive constants IJ/J (‘xists such that \fn{z)\ ^ for all 
positive integers n and for all values of ^ in a given region R and if the senes 

\ "f M 2 4" ^ 1/3 4 4 M„ 4" 

I,', convergent, then the senes 

f\(z) -f- ( 2 ( 2 ) + t,\(z) H- 4- fn(z) -b 

converges uniformly in /? 

PROOF To prove this, wc must show that foi any e > 0 tliero exists an integer 
N independent of 2 , such that for all values of 2 in R the absolute value of the 
remainder after 71 teiins in the senes of the f\ is Jess Ilian e whenever 71 exceeds N 
To do this, we note that 

\Rn{z)\ = l/nllU) + fr,^2{2) + | 

^ l/n-|-l(2)! -h |/t. + 2(^)| 4- 

(fi) ^ M n-\ \ H- Mn^2 4“ 

The last expression is just the remainder after n terms of the senes of tlie M's. 
Since this senes is convergent, by hypothesis, it follows that, for every e > 0, 
there exists an N such that tins remainder is les‘^ than e foi all n > N This value 
of N, arising as it does from a seravs of constants, is obviously independent of 2 . 
Moreover, from the ineipiality (()) it is deal that vhejiever n exceeds Ihi^ N, 
l/?n( 2 )l < e for all values of 2 in R Hence, the series of the f's is uniformly con¬ 
vergent, as asserted Incidentally, this theoiem implies a comparison test which 
proves that the series of the Ts is also absolutely convergent 

The Weierstrass M lest is merelv a sufficient test, that is, 
there exist uniformly convergent senes whose lerms cannot be 
dominated by the respective terms of any convergent series of 
positive constants t The M test, suffices for almost all applica¬ 
tions, however 

One useful property of uniformly convergent series is con¬ 
tained in the following theorem 


theorem 4 

If the terms of a uniformly convergent senes are multiplied by any bounded 
hinction of 2 , the resulting senes will also converge uniformly. 


* Karl Weierstrass (1815-1897), a Clerman mathernatinan, is often railed 
the "father of modern rigor ” 

t One example of such a senes will be found in Exercise 6 
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PROOF Let R be the region of uniform convergence of the series 
fi(z) +/i(«) +fiiz) -!-••• -\-fn(z) -h • ■ • 
and suppose that throughout R we have 

\g(z)\ ^ M 

Now, since the series of thefs converges uniformly, it follows that, corresponding 
to the infinitesimal e/Af, there exists an integer N such that 


Hence, 


\fn+liz) fn-\-i(z) -h 



for all n > N and all z m R 


\g{z)fn^i{z) -h g(z)fn+2(z) + 


1 = \9(^)\ l/n + l(2) +/»i+2(2) + • ‘1 

g Mlfn+liz) -^fn+2(z) 4- I 


= € for all n > AT and all z m R 
But this IS precisely the condition that the product series 


9(z)fi(z) 4- g(z)f 2 (z) 4- g(z)h(z) 4- • -h g{z)fn(z) 4- • * 

be uniformly convergent 

One important consequence of uniform convergence is 
embodied in the following theorem 


THEOREM 5 

The sum of a uniformly convergent series of continuous functions is a continuous 
function 

PROOF Let 

f(z) — fl{z) fliz) 4- /a( 2 ) 4- fn(z) + = Sh{z) 4" Rn{z) 

be a uniformly convergent series in which each term is a continuous function of z, 
and let t/3 be an arbitrary infinitesimal Then, since the series converges uni¬ 
formly, an integer N exists such that 

\Rn{z)\ < ^ for all n > N 

and for all values of z in the region of uniform convergence In particular, if Aiz 
is any increment such that z 4- is still in the region of uniform convergence, 
we also have 

\Rn{z 4- Ai 2)| < ^ for all n > N 

Moreover, since each term of the given series is a continuous function and since 
any finite sum of continuous functions is necessarily continuous, it follows that 
Sn{z) is continuous and, hence, that there exists an increment Aaz such that 

|iS „(2 4 - ^z) — Sn(z)\ < 4 for all Az’s for wh’ch \^z\ < lAjzl 

o 
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\S(z -h ^z) - /(z)| = \ISM + Az) -h Rn{z -h A2)1 - [Snit) -j- /e,(*)]| 
^ |iS „(2 + Az) - Sn(z)\ -h \Rn(z + Az)\ + \RM\ 

Hence, for all A^’s whose absolute values are less than the smaller of the quan¬ 
tities |Ai 2 | and \A 2 z\, it follows that 


\f(z -h Az) - /(2)1 < -^ -h ^ ^ € 

which is precisely what we mean by saying that/(^^ is continuous. 


Theorem 5 makes no assertion about the sum of a series of 
continuous functions if the convergence is nonuniform However, 
specific examples make it clear that m such cases the sum need 
not be continuous For instance, Example 2, in which we found 
the sum of the series 


z^ + 




1 + z ' ' (1 -h 2*)2 ’ (1 + 2 ») 


r.+ 


to be 


f(z) - 


(1 + 2^ 

lo 


Z 0 
z = 0 


shows that the limit of a sum of continuous functions may be 
discontinuous if the convergence is nonuniform In fact, m the 
neighborhood of z = 0, where the convergence is nonuniforni, 
the sum jumps abruptly from 1 -|- z* to 0, even though every 
term of the series is a continuous function of z for all values of z 
except z = ±t. 

One of the most important properties of uniformly conver¬ 
gent series is given by the following theorem 


THEOREM 6 

The integral of the sum of a uniformlv convergent series of continuous functions 
along any curve C lying entirely in the region of uniform convergence can be 
found by term-by-term integration of the series. Moreover, if each term of the 
series is analytic, so, too, is the sum 

PROOF Let the given series be 

/(2) =/lW -\-f2(z) + ' +/n(z) -f • • ■ 

Then, to establish the theorem we must show that 

J^f{z)dz= ^/i(z)dz-h j^/a(z)d2-l- + J^fn(z)dz + 

which, in accordance with the usual definition of convergence, requires that we 
prove the existence, for every e > 0, of an integer N such that 

n 

I ^ f(z) dz - ^ ‘i* I < « 

1 


for all 71 > iV 
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Now for any finite sum it is true that the integral of a sum is equal to the sum of 
the integrals. Hence, the left member of the last inequality can be written 

n n 

I L f{z) dz - LY, *** I “ \ (c ~ Z I “ I /c I 

1-1 

Let L be the length of the path of integration. Then, from the uniform con¬ 
vergence of the given series, we know that there exists an integer N such that 

|«,(z)| < I for all n > JV 

and for all z’s in the region of uniform convergence, in particular for all values 
of z on the path of integration C. If n > N, we can therefore write 

n 

I Ic ~ I Ic = I /c - Ic '‘^"1 

1-1 

which establishes the first part of the theorem 

To establish the second part, we suppose that the region of uniform con¬ 
vergence R is either simply connected or has been made simply connected by 
suitable cross cuts Then, if each tcrm/t is analytic in R, it follows from Cauchy’s 
theorem that the integral of each term around any simple closed curve in R (or 
its simply connected modification) is zero Hence, the integral of the sum f(z) 
around any closed curve is zero, and, thus, by Morera’s theorem,/(s) is analytic 
This complete.s the proof of the theorem. 

The companion result on the term-by-term differentiation 
of senes is contained in the following theorem* 


THEOREM 7 

If f{z) IS the sum of a uniformly convergent series of analytic functions, then the 
derivative of/(z) at any interior point of the region of uniform convergence can 
be found by term-by-term differentiation of the series 

PROOF Let z be a general point of the region of uniform convergence R, and 
let C be a simple closed curve drawn around z in R. If we write the given series as 

fiO =/i(0 fzit) -l- • • +/b(0 “!"■■■ 

where t stands for any of the values of z on C, we can multiply by the bounded 
function 

1 

2iri(t — z)* 

and, by Theorem 4, the resulting series 

m _ m , m . . . . m . 

2irt(f - zy 2irt{t - zy 2x1(1 - zy^ 2if [t - zy 
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Will also converge uniformly By Theorem 6. it can, therefore, be integrated term 
by term around C, giving 

J_ f ^ -1- f ^ _L f _L 

27ri ]v {i - zY 2 ti Jc (i - zY 2ri Jc (t - zY 

-L AL f Mtydi 

^ 2 ti Jr (i - zY 

But these integrals, by the first generalization of Cauchy's formula (Theorem 9, 
Sec 14.8), are precisely the derivatives of the respective terms of the given scries 
at the point z Hence, 

fiz) =m+fAz)^ • ■ +/:(z)~f 

which establishes the theorem 

It IS interesting and important to note that Theorem 7 does 
not apply to series of functions of the real variable x To justify 
term-by-term differentiation of .such senes, we require not uni¬ 
form convergence of the original .senes, but rather uniform con¬ 
vergence of the senc.s resulting from the term-by-term differen¬ 
tiation More predscly, we have the following theorem, which 
IS proved in most texts on advanced calculus 


TH EOR tM 8 

If /(^) = /i(x) -f f^{x) -h H- fn{x) i 

IS a convergent scries of functions of the real variable x, each of which possesses 
a continuous first derivative, then f'(x) can be found by term-by-term differen¬ 
tiation, provided the senes of the derivatives is uniformly conveigent 


EXERCISES 

1 Find the region of convergenre of the senes 

1 - i) f (z - 1)=^ + :z - lY -t 

2 Find the region of convergence of the senes 


1 1 I * _i__l_ 

2(z + 0 2=(/+ i)’ 2>(7 j)’’ 2‘(? -I- t)‘ ^ 


rind the region 




1 + 


1 / (R(^ \ j^A( 

? V + 1/ 3* V + V ^ + V 


+ 


4 Show that the entire region of convergenre of the senes of Example 2 consists of the exterior 
of the leiimiscate (i’ - y* 4- D* + = 1 together with the origin. 

6 Show that the series a: + rd - x) -H ar(l - xY 4- t(1 - x)> 4- converges for 

0 i j < 2, but that the convergence is nonuniforni in any subinterval which contains the 
origin 


* See, for instance, A E Taylor, “Advanced Calculus," p 602, Ginn and 
Company, Boston, 1955 
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6 Show that the series 


1 -I- j* 2 + I* 3 + I* 4 + I* 

converges uniformly over any interval of the i-axis, but that this cannot be established by 
the Weierstrass M test 
7 Show that the senes 






(0 ^ + l)(z + 1 ) (^r 4 - l){2z 4 1 ) (2z 4 1)(32 4 1 ) ( 3 r 4 1)(42 4 1 ) 


converges to 0 if z — 0 and to 1 if z 0 Show that the convergence is nonuniform in the 
neighborhood of the origin, but uniform m the exterior of any circle with center at the onum 


8 


What is the region of convergence of the series 


n “ 1 



Where does the senes converge 


e 

10 


uniformly? Show that the senes 


/ -77 converges uniformly 

n “ 1 


over any interval of the j-axis, 


but that it cannot be differentiated term by term for any value of x Explain 

Can the sum of a nonuniformly convergent senes of continuous functions be continuous"^ 

Prove Theorem 1 . 


15.2 

Taylor’s oxpansion 

Very often the series with which one has to deal in applications 
are those which are studied fornnally in elementary calculus 
under the name of Taylor's series Their systematic study begins 
with Taylor’s theorem:* 


THEOREM 1 

If f(z) is analytic throughout the region bounded by a simple closed curve C 
and if z and a are both interior to C, then 


/(z) = /(a) + f'(a)(z -a)+ f"{a) + 


where 


ft, = 


(z - o)" 


Ic <l — 


2 ' 

m dt 




27rt jc {t — a)^{t — z) 

PROOF We first note that Cauchy's integral formtila can be written 

fu) = J_ r r A 1_ 

Jc t — z 2vt Jc t — a 1 — (2 — a)/{t — a) 


dt 


Then, from this, applying the identity 

1 


1 — u 


== 1 -b w 4- w* H- ■ 


H- -b r 


1—16 


Named for the English mathematician Brook Taylor ( o88-1731). 
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to the factor 


_ 1 _ 

1 - (z - a)/{t - a) 


in the last integral, we have 


(z - ar/(< - O)” 1 

^\t-a) +r- ( 2 _a)/«-a)J‘'‘ 


^ J_ /■ Sit) dt z-a f fit) dl_ 
2 in Jet - a'*' 2 iti jc it - o)’ 

(2 - a)"-' 


+ 


27r7 


it 

f Jit)_dt , (f - a)’ 
Jr it - a)" 


2in 


f fit) dt 
Jc {t - a)^it - z) 


P>om the generalizations (Theorem 9, See 14 8) of Cauchy's integral formula 
it 18 evident that, except for the necessary factorials, the first n integrals in the 
last expression are precisely the corresponding derivatives of f{z) evaluated at 
the point z = a. Hence, 


/(z) = /(a) + f'(a)(z - a) 4- 


which estaolishes the theorem. 




(z - g)^ 
2ti ' 


(z — a)”'' 

(n - 1)» 

f _ fi t) di _ 

Jc {t — a)”(f — z) 


By Taylor’s series we mean the infinite expansion suggested 
by the last theorem, namely, 


fiz) 


"^fWiz — a) -f/"(«) - 2 T~ 


4-(a) 


(z - a)"-^ 
in - 


4- 


To show that this series actually converges to/(z), we must show, 
as usual, that the absolute value of the difference between /(z) 
and the sum of the first n terms of the series approaches zero 
as 7 L becomes infinite From Taylor’s theorem it is evident that 
this difference is 


Rniz) 


jz ~ fl)” r _ fit) di 

2 Tn Jc {t — a)*^{i — z) 


Accordingly, we must determine the values of z for which the 
absolute value of this integral approaches zero as n becomes 
infinite 

To do this, let Ci and C 2 be two circles of radii ri and r 2 
having their centers at the point a and lying entirely in the 
interior of C (Fig 15.2). Since f(z) is analytic throughout the 
interior of C, the entire integrand of Rniz) is analytic in 
the region between C and C 2 , provided that z, like a, lies in the 
interior of C 2 . Under these conditions, the integral around C 
can be replaced by the integral around 64 If, in addition, z is 
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FIGURE 15.2 

The circles Ci and 
Cl used in the 
proof of the con¬ 
vergence of 
Taylor’s senes 


intenor to Ci, then for all values of t on C 2 (the /’s which are 
now involved in the integration) we have 

\t — a\ = fa 
I2 - a| < ri 
If - 2I > ra - ri 

and 1/(01 ^ M 





Since 0 < ri < ra, the fraction (ri/ra)" approaches zero as n 
becomes infinite; therefore, the limit of /2„(z) is zero Thus wo 
have established the following important theorem 


THEOREM 2 

Taylor’s series, 


m = m + r(a)(z - a) + na) + /"'(a) + ■ 

is a valid representation of/( 2 ) at all points m the interior of any circle having 
its center at a and within which/(z) is analytic. 

The largest circle which can be drawn around z = a such that 
/(z) 18 analytic everywhere in its interior is called the circle of 
convergence of the Taylor’s senes of /(z) about th» point z = a. 
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The radius of this circle is called the radius of convergence of the 
series. Of course, this entire discussion applies without change to 
the case a = 0 , which is usually called Maclaurin’s series. 

The preceding discussion established a circular region around 
the point z = a within which the Taylor’s series of/(z) converges 
to f(z). However, it did not provide any information about the 
behavior of the senes outside the circle of convergence. Actually, 
the Taylor’s .senes of f{z) converges only witluii and possibly 
on the circle of convergence, and diverges everywhere outside 
this circle, as the following two theorems make clear 


THEOREM 3 

If the power series 

flo "h fii{z — a) -h a‘}(z — a)" -f 03(2 — a)’’ -|- ■ ■ 

converges for z — Zi, it converges absolutely for all values of 2 such that \z — a\ < 
|2i — a\ and uniformly for all values of 2 such that |2 — a| ^ r < jzi — o|. More¬ 
over, the sum to which it converges is analytic 

PROOF Since the given senes converges when 2 = 21, it follows that the terms 
of the series are bounded for this value of 2 That is, there exists a positive con¬ 
stant M such that 

|an( 2 i — a)”| = |a„| |2i — a|” ^ M for n = 0, 1, 2 , . 

Now let 2 o be any value of 2 such that 
|2o - a\ < |2i - a\ 

that IS, let 2 o be any point nearer to a than 21 is Then, for the general term of the 
series when 2 = Zq, we have 

la„(2n - a)”| = |an| |2o - a|” = |a„| \zi - a|» 

If we set 


2 n - a 

" ^ M 

2 o — (1 

i 1 — CL 


Zi — a 


( 1 ) 


Zq d 

z\ — a 


= k 


where k is obviously less than 1 , thi.s shows that the absolute values of the terms 
of tlie senes 


( 2 ) flo -f ai(2o — a) -f a2(2o — -f- <13(20 — a)* -h 

are dominated, respectively, by the terms of the scries of positive constants 

( 3 ) M Mk 4 - M/r' + Mk^ + 

This IS a geometric senes whose common ratio k is numerically less than 1 . It 
therefore converges and, hence, provides a comparison test which establishes 
the absolute convergence of the given senes ( 2 ) 

Unfortunately, the senes ( 3 ) does not provide a test senes which can be 


* Named for the Scottish mathematician Cohn Maclaunn (1698 1746), 
although another Scottish mathematician, James Stirling (1602-1770), 
anticipated by 25 years Maclaunn’s use of this result 
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used in applying the Weierstrass M test to the series (2), because it is clear from 
(1) that the terms of the series (3) depend on zq However, for values of such 
that 


( 4 ) 

we have 


\z(i - a\ ^ r < \zi - a\ 


k = 


Zo — a 


- 0 | 


= X 


and X is clearly a positive constant less than 1 which is independent of Zq. Hence, 
for all values of Zo satisfying the condition (4), the senes (1) is dominated term 
by term by the convergent geometric series of positive constants 


M -h MX + MX* + MX* + • • • 


and, therefore, by Theorem 3, Sec 15.1, the series (2) is uniformly convergent 
Finally, since each term a „(2 — a)" is an analytic function and since any 
point in the interior of the circle \z — a\ = \zi — a| can be included within a 
circle of the form |2 — a| = r < | 2 i — a\, it follows from the second part of 
Theorem 6, Sec 15 1, that, within the circle |z — a| = \zi — a|, the function 
to which the series converges is analytic. 

Now, let a be the singular point of/( 2 ) nearest to the center 
of the expansion z = a, and suppose that the Taylor’s series for 
f( 2 ) converges for some value z = zi farther from a than a is. 
By the last theorem, the series must converge at all points nearer 
to a than zi is, and, moreover, the sum must be analytic at every 
such point But this clearly contradicts the hypothesis that a is 
a singular point of/( 2 ), and, thus, we have established the follow¬ 
ing theorem. 


THEOREM 4 

It is impossible for the Taylor’s series of a function/(z) to converge outside the 
circle whose center is the point of expansion z = a and whose radius is the dis¬ 
tance from a to the nearest singular point of/( 2 ) 

The notion of the circle of convergence is often useful in 
determining the interval of convergence of a series arising as the 
expansion of a function of a real variable. To illustrate, consider 

f{2) = = 1- Z^ + Z*-Z* + 

This will converge throughout the interior of the largest circle 
around the origin in which/( 2 ) is analytic. Now, by inspection, 
f{z) is undefined at 2 = ±i, and even though one may be con¬ 
cerned solely with real values of z [for which 1/(1 -|- x*) is every¬ 
where infinitely differentiable], these singularities in the complex 
plane set an inescapable limit to the interval of convergence on 
the x-axis. We can, in fact, have convergence around x = a on 
the real axis only over the horizontal diameter of the circle of 
convergence in the complex plane 

As an application of Taylor's expansion, shall conclude 
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this section by establishing the simple but important result 
known as the theorem of Liouville:* 


theorem 5 

If f(z) is bounded and analytic for all values of z, then f(z) is a constant. 

PROOF To prove this, we observe first that since/(i:) is eveiywhere analytic, 
it possesses a power series expansion around the origin 

m = /(o) + f'(o)z + ■ ■ + .- + • • 

n: 


which converges and represents it for all values of z Now, if C is any circle having 
the origin as center, it follows from Cauchy’s inequality (Theorem 11, Sec 14 8) 
that 




where Me is the maximum value of |/(^)| on C and r is the radius of C Hence, for 
the coefficient of z" in the expansion of/(z), we have 

/^(O) M 

n! — ~ 

where M, the bound on |/(z)| for all values of z, which exists by hypothesis, is 
mdependL..t of r. Since r can be taken arbitrarily large, il follows, therefore, that 
the coefficient of z" is zero for n — 1,2, .3, In other words, for all values of z, 

f{z) = /(O) 

which proves the theorem 


A function which is analytic for all values of z is called an 
entire function or an integral function, and Liouville’s theorem 
thus states that any entire function which is bounded for all values 
of z is necessarily a constant 


EXERCISES 

1 Expand /(z) » (z — ])/(z -}- 1) in a Taylor series (a) about the point z — 0 and (b) about 
the point z *» 1 Determine the region of convergence in each case 

2 Expand /(z) — cosh z in a Taylor senes about the point z = iit What is the region of con¬ 
vergence of the resulting senes? 

3 Expand/(z) — z/(z -}- 1 )(z + 2) in a Taylor’s senes (a) about the point z — 0 and (b) about 
the point z — 2 Determine the region of convergence in each case. 

Without obtaining the series, determine the radius of convergence of each of the following 
expansions- 

4 tan z around z »» 0 6 Tan~* z around z *■ 1 

6 i/(e» _ 1) around z « 4i 7 x/(j’ 4- 2i T 5) around i - 1 

8 Prove that every polynomial equation P{z) ■» 0 has at least one root [Hint Assume the 
contrary and apply Liouville’s theorem to the function /(z) = \/P{z) ] 

9 Prove that, if the Tayl ir expansion of a function around a given point exists, it is unique 


* Named for the French mathematician Joseph Liouville (1809-1882), but 
actually due to Cauchy. 
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10 Prove that, if ^ anz" converges absolutely at one point on its circle of convergence, then 
n -0 

it converges absolutely and uniformly in the closed region bounded by its circle of 
convergence 


15.3 

L4iurent’s expansion 

In many applications it is necessary to expand functions around 
points at which or in the neighborhood of which the functions are 
not analytic. The method of Taylor's series is obviously inappli¬ 
cable in such cases, and a new type of series known as Laurent’s 
expansion* is required This furnishes us with a representation 
which is valid in the annular ring bounded by two concentric 
circles, provided that the function being expanded is analytic 
everywhere on and between the two circles As in the case of 
Taylor’s series, the function may have singular points outside 
the larger circle, and, as the essentially new feature, it may also 
have singular points within the inner circle The price we pay 
for this is that negative as well as positive powers of z — o now 
appear in the expansion and that the coefficients, even of the 
positive powers of z — a, cannot be expressed in terms of the 
evaluated derivatives of the function The preci.se result is given 
by the following theorem 


THEOREM 1 

If f(z) is analytic throughout the clo.sed region R bounded by two concentric 
circles, then at any point in the annular ring bounded by the circles, /(z) can be 
represented by the series 


m = X o.(z - a)» 

n W — «e 

where a is the common center of the circles and 

a f 

” 2iri Jc {t - 

each integral being taken in the counterclockwi.se sense around any curve C 
lying in the annulus and encircling its inner boundary 


PROOF Let z be an arbitrary point of the given annulus. Then according to 
Cauchy's integral formula we can write 

fit) dt 




f.+Ci t — 2 


= .L f /W . _L f 

2iri Jc, t — z 2iri Jci t — z 

where Cj is traversed m the counterclockwise direction and C\ is traversed in 


Named for the French mathematician Hermann Laiire; i (1841-1908) 
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v jfc 


ip} p 


The circles Ci F,!!' ..I 
and used in 
the derivation of 1/ ' i 
Laurent's expan- V 


;. ; ^ ^' I, 



the clockwise direction, in order that the entire intejiration shall be in the positive 
direction (Fig 15.3) Reversing the sign of the integral around T, and also chang¬ 
ing the direction of integration from clockwise to counterclockwise, we can write 

_ 1 /■ 1 f mdf 


= i [ nDdt _ 1 r mdt 

' 2 rik,i -2 2ir7 Jr. t-z 

^ j. f _I_ 

27ri Jcp ~ a I — (z — a)/(t — a) 

.1 f m _j_ . 

27ri JCi z — a 1 — (; — a )/(2 — a) 


Now, in each of these integrals let us applj^ the identity 


-— 1 -f- W + + -f- r-— 

1 — ?i 1—7/ 


to the last factor. Then, 


f{z) = L k- Ti +; -" + + 

2 ri Jc, < — t — a \( — a/ 

, (z - a)" /(< - aV;_ ] 

1 - (2 - a)/(t - a)J ' 


L f li'l. ' 

' 2 ti jci z — a 


1 + + 
z — a 


(< - a)"/(z - o)" 1 

1'- (t-a)/(2"-rt)J“' 


= L /" + -L 

2Trz jcz t — a 2 tci Jc^ {t — aY 


2 -ki Jc 2 {t — ay 

^ (z - r ^ ^ 

zTTi Jc, (i — a) 


+ SrT(h .) IcM <“ + 2T,<^- L » - -W) + 

2 «(. - a)" fc, 

D _ (z - “)" /■ /(O dt 

2irt Jc, (< -'o)"(t - z) 
ff = 1 f (t - dt 

2ir2(2 — a)" Jc, z — t 
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The truth of the theorem will be established if we can show that 
lim Rni = 0 and lim flni = 0 

n-»«o 

The proof of the first of these equations we can pass over without comment, 
because it was given in complete detail in the derivation of Taylor’s senes in 
Sec. 15.2. To prove the second, we note that, for values of t on Ci (Fig. 15.3), 

\t - a\ = ri 

\z — a\ = p 8&y, where p > ri 
Iz - t\ = 1(2 — a) - (f - a)| ^ p - ri 

and 1/(01 ^ M 

where M is the maximum of 1/(2) | on C\ Thus, 

J_ f (t — o)"/(0 dt 

i - a)" ir, 


\Rm\ = 


27rl(2 

_ 1 

l2iri| I 2 • 
ri^M 


a) 

^ fc 


Z — t 

\i - ohi/«)i id<i 


Cl 


\z-t\ 


_ M / nV 2yri 

27r \p/ p - ri 

\p/ P - r, 

Since 0 < ri/p < 1, the last expression approaches zero as n becomes infinite 
Hence, lim Rni = 0; and thus we have 

n—• • 

ft,', _ 1 f /(«) . r ^ f 1 (, n\ 

Jc. T--a + L2« Jc. (r- al^J 

+ r.i /■ 

|_27ri Jcz {t — aY 

+ [s. km <«] ,4-. + [4 /,.«- »>/(<> * 


(2 - aY -h 


1 


( 2 ' 


"■a? + 


Since f(z) is analytic throughout the region between Ci and Cz, the paths of 
integration C\ and Cz can be replaced by any other curve C within this region 
and encircling Ci. The resulting integrals are precisely the coefficients fln described 
by the theorem; hence, our proof is complete 


It should be noted that the coefficients of the positive powers 
of 2 — a m Laurent’s expansion, although identical in form with 
the integrals of Theorem 9, Sec 14 8, cannot be replaced by the 
denvative expressions 

n’ 

as they were in the derivation of Taylor’s series, since/( 2 ) is not 
analytic throughout the entire interior of Cz (or C), and, hence, 
Cauchy's generalized integral formula cannot be applied. Spe¬ 
cifically, f{z) may have many points of nonanalyticity within Ci 
and, therefore, within Cg tor C). 
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In many instances the Laurent expansion of a function is 
found not through the use of the last theorem, but rather by 
algebraic manipulations suggested by the nature of the function. 
In particular, in dealing with quotients of polynomials, it is often 
advantageous to express them in terms of partial fractions and 
then expand the various denominators in series of the appropriate 
form through the use of the binomial expansi^.n, which we list 
here for reference; 


THEOREM 2 

The expansion 

(s + 0* = S" + m-H + + . . . 

is valid for all values of n if ls| > \t\ If |sl ^ |/| the expansion is valid only if n 
IS a non negative integer. 

That such procedures are correct follows from the fact that the 
Laurent expansion of a function over a given annulus is unique. 
In other words, if an expansion of the Laurent type is found by 
any process, it must be the Laurent expansion 


EXAMPLE I 


Find the Laurent expansion of the function f(z) “ (7z — 2)/{z + l)z{z — 2) in the annulus 
1 < \z + \ \ <3 

As a preliminary step it is convenient to apply the method of partial fractions to f{z) and 
express it in the form 


fiz) 


-3 
z + 1 


1 

+ - 
z 



Now, after suitable rearrangement, these terms can be expanded into infinite senes by means of 
Theorem 2 and added to give the required expansion for/(z) 

To do this, we observe that since the center of the given annulus is r “ — 1, the senes we 
are seeking must be one involving powers of z -r 1 Hence, wc modify the second and third terms 
in the partial-fraction representation of f(z} so that z will appear in the combination z -f 1 
This gives us the equivalent expression 


^ z + 1 ^ (z 4 1) — 1 (z -b 1) - 3 
= -3(z 4 + \(z 4- 1) - 1]-' 4- 2[(z 4- 1) - 3]-i 


However, according to Theorem 2, the senes for [(z + 1) — 3]~' will converge only where 
k 4 1| >3, whereas we require an expansion valid for jz + 1| < 3 Hence, wo rewrite this term 
in the other order, [—3 4 (z 4 1)]“', before expanding it. Now we can apply Theorem 2, 
obtaining 

f(z) - -3(z 4 1)'* 4- [(^ 4 1) - l]-‘ + 2[-3 4- fz + I)]"' 

- -3(z + 1) ‘ -h [(z + 1)-' +(z -f- 1)-* -h ( + 1)-* + 1 

+ 21 "-™- - — - ^ - 1 

[ 3 9 ' 27 81 J 

-b (z -b 1)^* - 2(z + l)-i - I - f (z -f 1) 

- + 1)» - ■ 


1 < |z 4 1| < 3 
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It 18 important to note that/(z) has two other Laurent expansions around the point z — — j 
One 18 valid in the annular region between a circle of arbitrarily small radius around z ■» -1 
and a circle of unit radius around z — — 1 The other is valid in the region exterior to a circle of 
radhis 3 around z — — 1 (Fig 15.4) Each of these can be found, as above, by suitably rearrang- 


FIOURE M.4 

The regions of 
validity of the 
three Laurent 
expansions of 
(7z - 2)/[(z + 
l)z(z - 2)1 
around z — — 1 


ing the terms in the partial-fraction representation of f{z) and then expanding these terms hy 
means of Theorem 2 Thus, in the innermost region we have 

f(z) = -:i{z + 1)-' + [-1 + u + 1)]‘ + 2[-3 + {z + l)l-> 

- -3(2 + l)-> + [- I - (z + I) - (2 + 1)» - (r + 1)> - ] 

r _ 1 _ 2 + 1 _ (2 + 1)» _ 1)_' _ 

"^^ 1 3 9 27 81 

- - 3(2 + !)-■ - n ,' - + 1 ) - 29.^,(2 + I )’ 

- 8?^,(2 + D* - 0 < |2 + 1| < 1 

Similarly, m the outermost region we have 

f(z) - -3(2 + 1)-' + [(z + J) - l]-' + 2[(Z + 1) - 3]-‘ 

-3(2 + !)-■ + [(2 + l)-> + (2 + 1)-' + (2 + 1) ' + ] 

+ 2[(2 + !)-■ +3(z + l)-“ + 9(2 + !)-• + ] 

- + 19(2+ !)-■+7(2 + 1)-' |2 + 1| > 3 

Incidentally, the fact that we have obtained these Laurent expansions without using the 
general theory means that we can evaluate the integrals in the coefficient formulas by comparing 
them with the numerical values of the coefficients we have found by independent means For 
instance, in the first expansion the coefficient of (z + 1)"* is —2 On the other hand, according to 
the theory of Laurent’s expansion, the coefficient of this term is 

If \ f 7z - 2 

JC ^ ;c (z -f l)z(z - 2) ^ 

where C is any closed curve lying in the interior of the circle |z 4- Ij “3 and enclosing the circle 
|z -h 1| " 1 Thus, although we have done nothing resembling an integration, we have none¬ 
theless shown that 



JL f 7z -2 

2ti Jc (z -t- l)z(z - 2) 


-2 


or 


f 7z - 2 
JC (z 4 l)z(z - 2) 


dz 


— 4irt 


a result, incidentally, which could not have been obtained by a direct applicat on of Cauchy’s 
integral formula, as m Example 2, Sec. 14.8. 
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EXERCISES 

1 Expand/(z) - 1/U - l)(z - 2) 

a For | 2 | < 1 b For 1 < |z| < 2 c For 2 < \z\ 

d For 0 < |2 - 1| < 1 e For (z - 1 | > 1 

f For 0 < |z - 21 < 1 g For |z - 2 | > 1 

2 Obtain two distinct Laurent expansions for/( 2 ) = (82 + l)/( 2 * - 1 ) amund z - 1 , and tel! 
where each converges 

3 Expand/(z) = l/z *(2 — i) in two different Laurent expansions around 2 -» and tell where 
each converges 

4 Construct all the Laurent expansions of f(z) * 1 /z(z — — 2) around 2 == — 1 , and tell 

where each converges 

6 Find the value of /(z) dz if C is the circle |z| - 3 an.I f(z) is 


1 


+ 2 ) 
1 


J_±2 

z{z 4 T) 


+ 1)' (z 4 l)(z 4- 2) 

6 If A: IS a real number such that k* < 1, prove that 


1 _ 
-f D* 


z(z 4 1)(2 -f 4) 




/c" sin (n + 1)0 


sin e 

1 - 2A- cos 0 + fr* 


V , / . COB 0 — 

7 k’* cos (n 4 1)0 =* —--- 

L, 1 - 2A: cos 0 4 

n — 0 

[Hint Expand (z — k) * for | 2 | > k, set 2 *=* c'*, and equate real and imaginary components 
in the resulting expression | 

7 Criticize the following argument Since (by long division, for instance) 

- z -f 2 * 4 - 23 -f ^4 4 


1 - z 


and 


1 1 1 

, 1 4 - + - + - + 

z — 1 z z* z* 


z z 

-4-« 0 

1 - z z - 1 


and since 

therefore, by adding these two senes we obtain 


+ i + “ + - + 1 + J z’ + 


- 0 


8 Criticize the following argument The senes 
j 4 1 4 z 4 z’' + 4 z* 4 

converges to the sum iy(z) = —-for all values of 2 such that \z\ < 1 , including 2 0 , 

z(l - z) 


since 


|5(z) - S„(z)\ 


1-z) 




-41+2 + 

Z 
1 




1 - z - 


1 


— 1 — 2 — 


1 - Z 
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and this expression clearly approaches 0 as n becomes infinite for all values of z such that 

kl < 1. 


9 a Show that the Laurent expansion of /(z) ■= sinh 


(-0 


m powers of z is /(z) 


2 ] flnz", where 


1 

On “ — / cos nd sinh (2 cos 6) dd 
2ir JO 

(Hint In the formula for provided by Theorem 1 , take the curve C to be the circle |z| = 1 
On this circle let the variable of ihtegration t be taken in the form t — e** Finally, verify 
that the imaginary part of the integral for a* is equal to zero ) 


b Show that the coefficients in the Laurent expansion of /(z) 

1 f2w 

z are given by the formula Oi, ■» — / cos nB sin (2 cos B) d 

2t jo 


( 

— Bin I z d — I 1 


- J in powers of 


c What are the coefficients in the Laurent expansion of/(z) = cosh 


d What are the coefficients in the Laurent expansion of/(z) •» cos 


.h(,+2) 

.(, + 0 


in powers of 


in powers of z? 


10 liCt /(z) “ /(re’*) — be a function which is analytic in some annulus having the origin 

as center and containing the circle jzj — 1 Taking this circle as the curve C in the formula 
for an in the Laurent expansion of f(z), show that 

1 /■2r IV' /‘2» 

F(r,B) “ / F(1,0) d<> -b - ) / F(1,0) cos n(B — </») d<t> 

2ir JO V ^ JO 
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16.1 

The residue theorem 


In Sec. 14 h we defined a singular pomi of a fund ion f{z) as a 
point where j(z) is not analytic hut in every neighborhood of 
which there are points where/( 2 ) is analytic If e = a is a singular 
point of the function /( 2 ), but if there exists a neighborhood of a 
in which there are no other singular points of f{z)^ t hen z ~ a m 
called an isolated singular point, ('learly, if z ~ a is an isolated 
singularity of f{z), then f{z) will possess a Laurent expansion 
around z — a which will be valid in the interior of an annulus 
whose outer radius is the distance from a to the nearest of the 
other singular points of f(z) and whose inner radius can be taken 
arbitrarily small 

If the Laurent expansion of f{z) in the neighborhood of an 
isolated singular point z = a contains only a finite number of 
negative powers of z — a, then z - is'called a pole of f{z) If 
(z — ay is the highest negative powei in the expansion, the 
pole IS said to be of order m, and the vsuni of all the terms contain¬ 
ing negative powers, namely, 


Ci-m 

(z - a) 


- + 


^ {z - ay ^z- 


a 


IS called the principal part of/( 2 ) at 2 = o If the Laurent expan¬ 
sion of f{z) in the neighborhood of an isolated singular point 
z = a contains infinitely many negative powers of 2 — a, then 
2 = a is called an essential singularity of f(z) For instance, since 


_ 




_i _ 

(z - iy 


r-i +1 -(*-!) + 


0 < |z - 1| < 1 
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this function has a pole of order 2 at 2 = 1, and its principal 
part there is 


1 

(^ - 1)^ 



t 


On the other hand, since is represented for all values of 2 
except 2 = 0 by the series 


pii2 _ 1 _i_ 1 I—L j_ _I—!_ 


it has an ejssontial singularity at the origin 

In passing, we note that, if the terms in the expansion of 
fiz) around a pole of order m, say z = a, are put over a common 
denominator,/( 2 ) will contain the factor 1/(2 — a)"* Conveis.'ly, 
if a function/( 2 ) is expressed as a fraction in lowest terms, then 
the presence of a factor of the form (2 — a)"* m the denominator 
implies that/( 2 ) has a pole of the niih order at 2 = a In most appli¬ 
cations this IS the way in which the poles of a function are found 
As we suggested at the end of the last chapter, the coefficient 
a_i of the term (2 — a)~^ in the Laurent expansion of a function 
i{z) IS ot great importance because of its connection with the 
integral of the function, through the formula 


In particular, the coefficient of (2 — a)"‘ m the expansion of/( 2 ) 
/7? the neighborhood of an isolated singular point is called the 
residue of f{z) at that point 

Now consider a simple closed curve C containing in its 
interior a numlx*r of isolated singularities of a function f(z) If 
around each singular point we draw a circle so small that it 
encloses no other singular points (Fig 16 1), these circles, 
together with the curve C, form the boundary of a multiply con¬ 
nected region in which/( 2 ) is everywhere analytic and to which 
Cauchy’s theorem can, therefore, be applied This gives 

S. /■ /W ■" + i. /r. -f» '<■■ + + 2^. ■" - » 

If we reverse the diiection of integration around each of the 
circles and change the sign of each integral to compensate, this 


t It should be noted that, although we can also write 
1 _ ((z - 1) -f- 1]-* 

ziz - 1)> " {z -“!)• 


■•■(/-l)* (z-'T)■*"'■ (z - !)• 


|r - 1| > 1 


the fact that this expansion contains infinitely many negative powers of 
z — \ does not contradict our observation that \/z{z — 1)* has a pole of 
order 2 at z » 1 For this senes is valid only oulttide the circle [z - 1| = t. 
whereas the presence of poles and essential singularities is determined by the 
structure of the particular Laurent expansion which is valid in the mnennont 
annulus, or deleted neighborhood, of the ]>oint in question 
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FIGURE 16.1 

The circles Ci, 
Cj. , Cn 

enclosing, reapec 
lively, the singu 
lar points Zi, zz, 

, Zn within 
a simple closed 
curve 


can be written 

= /c, /(^) 

where all the integrals are now to be taken in the counterclockwise 
sense But the integrals on the right are, by definition, just the 
residues of f(z) at the various isolated singularities within C. 
Hence we have established the important residue theorem: 

T H E O ' E M 1 

If (7 is a closed curve and i(f(z) is analytic within and on C except at a finite num¬ 
ber of singular points in the interior of C, then 

dz = 27ri(ri -f rj -h * -f ?’„) 

where ri, rj, , r„ are the residues of f(z) at its singular points within C 



What 18 the integral of 

-3r -I- 4 

l)(z -T) 

around the circle |z| - 

In this case, although there are three singular points of the function, namely, the three 
first-order poles at z - 0, z - 1, and z - 2, only z - 0 and z - 1 he within the path of integra¬ 
tion Hence, the core of the problem is to find the residues of /(z) at these two points 

To do this, it 18 natural to begin by constructing the partial-fraction representation of f{z), 
namely, 

2 1 1 

Then, in the neighborhood of z — 0, we can write 


+ (2 - z)- 


- + (1+ z + z« 




+0 i + ■) 
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Hence, the residue of/(») at z - 0, i e., the coefficient of the term 1/z m the last expansion, is 2 f 
Also, in the neighborhood of z * 1, we have 

/(*) - 2(1 + (» - l)]-i - + (i _ (* _ 1)]-. 

- 2(1 - (* - 1) + (j - 1)« - • • ] - + [1 + (* - 1) + (* - 1)» + • . ] 

- + 3 - (* - 1) + 3(* - D* - ■ • 

Hence, the residue of /(z) at z — 1 is —1. Therefore, according to the residue theorem. 

The determination of residues by the use of series expansions, 
in the manner we have just illustrated, is often tedious and some¬ 
times very difficult. Hence, it is desirable to have a simpler alter¬ 
native procedure. Such a process is provided by the following 
considerations Suppose first that/( 2 ) has a simple, or first-order, 
pole at z = a. It follows, then, that we can write 

/(«) = + do + a,(z - o) + 

z — a 

If we multiply this identity by z — a, we get 
(z - a)/(z) = a_i -h ao(z - a) -f ai(z - o)* ■ 

Now, if we let z approach a, we obtain for the residue 

(1) a_i = lim [(z - a)/(z)] 

#-♦0 

If /(z) has a second-order pole at z = a, then 

/(«) = + do + a,(z - d) + Oj(z - d)* + • 

Now, to obtain the residue o_i, we must multiply this identity 
by (z — a)* and then differentiate with respect to z before we 
let z approach a. The result this time is 

(2) a_i = hm — [(z - d)y(z)] 

The same procedure can be extended to poles of higher order 
leading to the formula contained in the following theorem: 


THEOREM 2 

If /(z) has a pole of order m at z = a, then the residue of /(z) at z = a is 


t Smce l/(z — 1) and l/(z — 2) are both analytic in the neighborhood of 
2 - 0, it 18 evident in advance that their expansions around z - 0 will be, 
not Laurent, l^t Taylor eeries and, hence, will contain no neutive powers 
of z Thus neither of these terms can contribute to the residue of /(z) at 
z - 0, and so it is actually unnecessai^ to obtain their expansions. The same 
thing is true of the terms 2/z and l/(z — 2) around z 1. 
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In many problems the order of the pole at z = a will not 
be known in advance In such cases it is still possible to apply 
Theorem 2 by taking m = 1, 2, 3, . , in turn, until for the 

first time a finite limit is obtained for a„ \ The value of m for 
which this occurs is the order of the pole, and the value of a.i 
thus determined is the residue If/( 2 ) has an essential singulanlv 
at z ~ a, however, this process fails, and the residue cannot he 
determined by means of Theorem 2. 

EXAMPLE 2 

What 18 the residue of f{z) =»(!-)- z)/{\ — ros z) at the origin 

Here the order of the pole is unknown, so it appr^ars that we may have to proceed tentatively, 
trying =■ 1, 2, 3, , in turn, until foi ihe first time we obtain a finite value for the residue 

However, if we replace cos z hy its Maclaurin e\pan‘^ion, we obtain for f{z) the expression 


1 + f 2(1 + z) 



and the factor r® m the denominator now identifies the pole as of the second order. Hence, apply¬ 
ing Theorem 2 with m »= 2, we have 



- 2 


EXERCISES 

1 Find the residue of f{z) « z/{z^ -h 1) (a) at z = i and (b) at 2 = — t 

2 Find the residue of f(z) =» (z -h l)/z’(z — 2) (a) at z — 0 and (b) at z “ 2 

8 Find the residue of /(z) ™ z/{z^ + 2z d- 5) at each of its poles 

4 What 18 the residue of/(z) — l/(z "h 1)* at z —1? 

6 What 18 the residue of /(z) * tan z at z =■ Tr/2? 

6 What is the residue of /(z) *= z/fcosh z — cos z) at z ■= 0? 

7 What is the residue of /(z) l/(z - am z) at z -» 0^ 

8 What IS the residue of f(z) = \/(e* — 1) at z =■ 0’ 

9 If C is the circle |z| - 4, evaluate /(z) dz for the functions 


a f(z) 



b f{z) 


z -I- 1 
zKz -h 2) 


C f(z) 


1 

z(z - 2)» 


e f(z) 


1 


d f(z) 

f fiz) 


z« 

(z* + 3z + 2)» 

1 

z(z» + 02 + 4) 
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10 If C is the circle \z\ - 2, evaluate f(z) dz for the functions 


■ f(z) “ tan z 
1 


b f{z) - 


c f{z) 


d /(.).- 


e /(z) — ze*' 


f f(z) - 


16.2 

The evaluation of real definite integrals 

There are several large and important classes of real definite 
integrals whose evaluation by the theory of residues can be made 
a routine matter. The results in question are contained in the 
next three theorems. 


THEOREM 1 

If /?(cos 6,s\n d) IS a rational function of cos 6 and sin 6 which is finite on the 
closed interval 0 ^ 6 ^ 2ir and if f{z) is the function obtained from R by the 
substitutions 

z z~^ . z — z~^ 

cos e = sin e = 


then R(cos 6,sin ff) dd is equal to 2m times the sum of the residues of the 
J{z) 

function — at such of its poles as he within the unit circle \z\ = 1. 


PROOF As a first step, let us transform the given integral by means of the 
substitution z = e‘*, according to which 


cos Q = 


ei9 _|_ 
2 


Z -h 

2 


sin d 





Under this transformation the original integrand becomes a rational function 
of z, which we call/(z). Furthermore, as 6 ranges from 0 to 2ir, the relation z = e*' 
shows that z ranges around the unit circle \z\ = 1. Hence, the transformed inte¬ 
gral is 



dz 

tz 


where C is the unit circle. By the residue theorem, the value of this integral is 
2ti times the sum of the residues at those poles of its integrand, namely, /(^)/^^, 
which lie within the unit circle. Since this integral is equal to the original one, 
the theorem is established. 
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EXAMPLE 1 


Evaluate 


r 


cos 26 de 

1 — 2p cos S + p® 


(-1 < p < 1) 


Since the denominator of the integrand can be written 


1 — 2p cos P 4* p* =■ 1 — 2p -|- p* + 2p — ?p cos 6 
- 1 4- 2p 4- p> — 2p — 2p cos 


(1 — p)* 4- 2p(l — cos 6) 
(1 4- p)* - 2p(l 4- coB«) 


it IB clear that it can never vanish for <p<l Hence, the preceding theorem 

IS applicable Now 

„ -f 2® + Z-t 

cos 26 =»-- =- 

2 2 

and thus the given integral becomes 


r 2* 4- ^ * 1 dz r z* \ z dz 

J 2 I — 2p(z 4- z“') '2 + p® iz J 2z® z — pz® — p + p*z iz 

r _ a -f g*) dz _ 

J 2iz®(l — pz)(z - p) 

Of the three poles of the integrand, only the first-order pole at 2 » p and the second-order 
pole at 2 =» 0 lie within the unit circle For the residue at the former we have 


lim (z — p) 


_1^ + z_* 

272®(1 — pz)('’ 


- p) 


_1 4- P* 

27p®(l — p®) 


For the 'Sidue at the second-order pole 2 =» 0, we have 


-_L±i^- 

dz L 272®(2 - p2® - p -f P»2) J 

Inn P + P®0( 42») - n + 2« )(1 - 2pz -b p») 

^0 2i(z - pz® - p 4- p® 2 )* 

I 4 p® 

2ip* 

By Theorem 1, the value of the integral is therefore 

[ 2ip®(l - p®) 2ip* J I — p® 


THEOREM 2 

If Q(z) IS a function tvhich is analytic in the upper half of the e-plane except at a 
finite number of poles none of which lies on the real axis and if zQ{z) converges 
uniformly to zero when 2 —^ 00 through values for which 0 ^ arg 2 ^ it, then 

/- « equal to 2ri times the sum of the residues at the poles of ^( 2 ) which 

he in the upper half plane 

PROOF We consider a semicircular contour with center at 2 =■ 0 and with 
radius R large enough to include all the poles of Q{z) which lie in the upper half 
plane (P'lg 16 2) Then, by the residue theorem, 

jc +c ~ X poles within Ci 4- C 2 

j-R da: 4- Q{z) dz = 2iri ^ residues 


or 




706 


THf TNtOlY OF MSIDUflS 


CHAP. 16 


nOURE 16.2 

A Bemicircular 
contour enclosing 
all the poles of a 
function which lie 
in the upper half 
plane. 



Hence, 

(1) I Q(x) dx — 2 x 1 ^ residues | = | “ Q(z) dz | 

In the integral on the right, let z = Re*, so that dz = Rie* de = iz dB. Then 

I “ X. lo I ^ \^Q{^)\ \dQ\ 

But from the hypothesis that |zQ(z)| converges uniformly to zero when 2 —► oo and 
0 ^ arg 2 ^ X, it follows that, for any arbitrarily small positive quantity, say c/x, 
there exists a radius Rq such that 


\^Q{^)\ < - 

X 

for all values of z on C 2 whenever R > Rq. Thus, for R > Ro, 

IJ 1^Q(^)| Idel < 1 IJ |d9i = . 

This, coupled with (1), proves that 

lim [ ^Q(x) dx = 2 x 1 y residues 

Since the limit on the left is what we mean by Q{x) dx,] the theorem is 
established. 


In particular, the quotient of two polynomials p{x)/q{x) 
automatically satisfies all the hypotheses of the last theorem 
whenever the degree of the denominator exceeds the degree of the 
numerator by at least 2. Hence, we have the following highly 
important corollary 


/ R 

Q{x) dx is only the principal value of the integral 
-R 

j 0 (a:) dx, whose correct definition is 

lim Q(x) dx -f lim Q{x) dx 
J-R Jo 


where R and S become infinite independently of each other As the simple 
function Q(x) b x shows, the principal value of an integral may exist when 
the mtegral itself is undefined. However, under the relatively stringent 
conditions of Theorem 2 the existence of the principal value implies the 
existence of the integral itself 
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COROLLARY 1 

If p(^) ttnd q{x) arc real polynomials such that the degree of gix) is at least 2 more 
than the degree of p(x) and if g{x) = 0 has no real roots, then 


/ • pix) j ^ viz) 

-• ~ ^ residues of at its poles in the upper half plane 


EXAMPLE 2 


/*-> T*dx 

Evaluate / - 

+ 6 ») 

This is an integral to which the corollary of Theorem 2 can surely be applied. The only poles 
of 


(2> -fT’Xz* -h 6») 


are at z - ±ai, ±bi Of these, only z - a? and z - fn he in the uppei half plane. At z - ox the 
residue is 

lim (z — oi)—--—-=-- .=- 

r-fli (z - a7)(z + atXz* b /)») - u^) 2i(a’ - 6*) 

From symmetry, the residue at z “ In is obviously b/2i{h^ — a lleru’e, the value of the 
integral is 

L2i(a>-5») 2i(6*-o»)J o + fc 

If Q(z) satisfies all the hypotheses of Theorem 2, then does 
c*'"*Q( 2 ), provided m > 0. For e''"' is analytic everywhere, and, 
under the assumption that m > 0, its absolute value is 

_ l^imxp—m|/| — 

which 18 less than or equal to 1 for all values of y in the upper half 
plane. Therefore, 

\e'”^‘zQ{z)\ ^ \zQ(z)\ 

and thus, if the latter converges uniformly to zero when z —► » 
and 0 ^ arg z ^ ir, so will the former Hence, the conclusions of 
Theorem 2 can be applied equally well to e”"'Q( 2 ), and we can 
write 

(2) dx = 'lin ^ residues of e‘'"*Q(z) at its poles in the 

upper half plane 

Separating the integral in (2) into its real and its imaginary parts 
and equating these to the corresponding parts of the right-hand 
side, we obtain the following useful result: 

COROLLARY 2 

^f Q{z) is analytic in the upper half of the z-plane except at a finite number of 
poles none of which lies on the real axis and if |zQ(z)| converges uniformly to zero 
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when z becomes infinite through the upper half plane, then 

cos mx Q{x) dx = ^ imaginary parts of the residues of 

e'”^Q(z) at Its poles in the upper half plane 
j ^ sin mx Q(x) dx = 2 ir^ real parts of the residues of e^^‘Q(z) 

at its poles m the upper half plane 


EXAMPLE 3 


„ , cos mx , 

Evaluate /-ax. 

7-- 1 + T* 

To do this, wo consider tho related function c*'”*/(l 4- z^) The only pole of this function in 
the upper half piano is 2 t, and the residue there is 


lim (z — i) 

I—»t 

Hence, by Corollary 2, 


gim. 

— tXz 4- 1 ) 


g-ir 




/ • COS mx i te~^\ 

-- 1 + 1 * V 2 / 

Incidentally, the fact that tho ro^^idue at z * z is a pure imaginary quantity conhrma the observ;' 
tion, obvious from symmetry, that 


sin mx 

- dx 

1 4- J* 


As a final result on the evaluation of real definite integrals bv 
the method of residues, we have the following theorem, whoso 
proof we omit because of its relative intricacy.* 


THEOREM 3 

If Q(z) is analytic everywhere in the z-plane except at a finite number of polc^ 
none of which lies on the positive half of the real axis and if \zH}{z)\ converge^ 
uniformly to zero when 2 —> 0 and when z —> then 

x“"^Q(x) dx = —y residues of ( — 2 )®“^ 0 (z) at all its polos 

70 sin air 

provided that arg z is taken in the interval ( — 7 r,ir) 

In applying this theorem it must be borne in mind that unless n 
is an integer, ( —is a multiple-valued funciion which, ac¬ 
cording to Eq. (23), Sec 14 7, is to be interpreted as 

^ 2)“"^ = g(®—l)ln(—*) = g(o—Dlln ■rg (—i)l —^ arg Z ^ TT 

EXAMPLE 4 

Evaluate / -dx, 0 < a < 2. 

70 1 4- X* 

For a within the specified range, the conditions of Theorem 3 are fulfilled, hence the given 
integral is equal to ^/(sin oir) times the sum of the residues of ( —z)''“V(l + z®) at 2 = ±i 


* See, for instance, E T Whittaker and G N. Watson, “Modern Analysis,” 
p, 117, The Macmillan Company, New York, 1943. 
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2 - t we have for the residue 

hm {z - t) ^ 

(z - i)(z H- i) 21 * 2t " 2t 

At r — — t, for the residue we have 

Iim (Z + l)-- - Bi -i. - 

(z-f t)(2 — i) —2t —2t —2t 

The value of the integral is, therefore, 


giTu-n/i _ g-i»(o-i)/i 


T (a — l)ir 

-sin- 

sin OT 2 

IT air IT 

,-COB — — - 

sm air 2 2 sin (aT/2) 


For definite integials not covered by the theorems of this 
section, evaluation by the method of residues, when possible at 
all, usually requires considerable ingenuity in selecting the ap¬ 
propriate contour and in elinuruiting the integrals over all but the 
desired portion of the contour Several examples of this sort will be 
found, with hints, in the exercises. 


Evaluate the following integrals by the method of residues' 


2p sm + p* 


-1 < p < 1 


yo (a -f 6 cos tf)* 

* r __ 

Jo 2 cos 0 -b 3 sin 0 + 7 
^ 7«- cos 2(9 d9 

io 5 4- 4 cos 9 

» f* 

]-•{!+ !«)• 

10 f‘ -5UL_ 

12 

Jo 1 4 X* 

14 r - "" d. 

y-- (x - o)» 4 6« 

1 a f ^ 

10 / - dx 

Jo 1 4 x« 

18 /■• _ / ^ _ dx 

y-- (x* 4 a*)(x* 4 6*) 

20 /•—?!::!—dx c 
Jo {X 4 6)(x 4 c) 

21 r -- dx 0 

Jo (X - 6)* 4 c« 

22 f" _ ^ _ 

Jo (X 4 6)(x 4 c)(x 4 d) 


(x - o)» 4 6« 


Jo cos 4 2 sill ^43 
f2w sm* 9 d9 

h / --- 0 < fc • 

Jo o 4 D cos 9 

7 r 

y-• X* 4 a* 

/ • T* dx 

-- r+7> 

dx 

Jo (o' + !>)• 

/ • COB mx 

- dx 

-•« (x — a)* 4 6* 

/■» cos mx 

« jo 

/ - COB mx ^ 

-- (i> + O'XI* + 6«) " 

/■• X Sin mx , 

19 / -- dx 

y-» 1 4 X* 


20 / -da; 0<o<2 0<6, c 

Jo (X 4 6)(x 4 c) 


(X - 6)* 4 ( 


dx 0 < a < 2 


dx 0 < o < 3 0 < 6, c, d 


■dx 0 < a < 3 


/- X"-* 

yo 1 4 i‘ 


dx 0 < a < 4 
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'0 1+1 
substitution y 


26 Show that r(o)r(l — a) — ir/(8in air) for 0 < a < 1. [Hint. Consider the integral 

ya—1 

- dy, and evaluate it first by the method of residues and then by making the 

z/(l — x) and expressing it in terms of gamma functions ] 
f ^ Sin X IT 

26 Show that - dx — - (Hint 'Integrate C'/z around the contour shown m Fig 16 3, 

and let r —♦ 0 and R—* » ) 


FIGURE 16 3 



27 Show that 

tour shown in Fig 16 4, let r —» 0 and R 


u -rig 1 

4 '] 


and recall (Exercise 10, Sec 7 3) that 


FIGURE 16.4 



28 If /(z) has a number of first-order poles on the real axis, but otherwise satisfies all the condi¬ 
tions of Theorem 2, show that the principal value of j e'”*^f{x) dx is equal to 2x1 times 

the sum of the residues of c'’"‘/(z) at its poles in the upper half plane plus tx times the sum of 
the residues of e‘”*'/(z) at its poles on the real axis [Hint Use a contour like that shown in 
Fig 16 3, suitably indented around each of the poles of /(z) which lies on the real axis 1 

29 What IS the Fourier expansion of the periodic function---(0 <6 < a)? Discuss 

a + 0 cos B 

from the point of view of Theorem 3, Sec. 6 3, the limiting behavior of the Fourier coeffi¬ 
cients of this function as n —♦ oo 
cos mx 


30 Show that 


/ « CO 
-DC* 


- dx 


+ e~* 

around the contour shown in Fig. 16 5 and let R 


[Hint Integrate the function «•"*'/(«' + c *) 
.1 



FIGURE 16.5 
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16.3 

The complex inversion integral 


( 1 ) 


( 2 ) 


(3) 


We are now in a position to appreciate more fully the significance 
of the complex inversion integral of Laplace transform theory. 
In Sec. 6 8 we defined the Laplace transform of a function/(/) 
to be 

£(/«)! = j‘ me-dt 
and we showed that conversely 
m = JEf/(01e"rfs 


s being a complex variable It la interesting now to reconsider 
the derivation of (2) in the light of complex variable theory and 
to investigate how this formula can be applied to the determina¬ 
tion of a function when its transform is known 

In the complex plane let ^(z) be a function of z, analytic on 
the line x — a and in the entire half plane R to the nght of this 
line. Moreover, let 1^(2) 1 approach zero uniformly as z becomes 
infinite through this half plane Then, if « is any point in the half 
plane R, we can choose a semicircular contour C = Ci -f- Cj, 
as shown in Fig 16 6, and apply Cauchy’s integral formula, 
getting 




dz 


1 1 f 

2rt z — s 2in Jc* z s 


Now, for values of z on the semicircle and for h sufficiently 
large, we have 


Iz — 5| ^ 6 - — a| ^ 6 — ls| - \a\ 


whether a is positive, as shown in Fig 16.6, or negative. Hence, 
letting M denote the luaximum value of |</>(z)| on C 2 , we have 


f \dA < _ - _ f \dz\ = _ 

Jct z ~ 8 — jc, \z — 8\' ' 6 — l^l — jal ici 6 — |sl — ja 


k(2)| 


M 


rbM 


figure 16.6 

The contour used 
to obtain the 
complex inver¬ 
sion integral. 
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As h becomes infinite, the fraction 
b 

b - |a| - la| 

approaches 1, and at the same time M approaches zero, since, 
by hypothesis, |0(z)| converges uniformly to zero as z becomes 
infinite through the right half plane R. Hence, 



and in the limit we have, from (3), 


4>i8) 


lim 


2ti Ja+tb Z — 8 2iri 


/. 


0-f t* 


8 — Z 


dz 


Let US now attempt to determine the function of t whose 
Laplace transform is ^(a). Taking the inverse of as defined 
by the last expression, we have 

Assuming that the operations of integrating along the vertical 
line X = a and applying the inverse Laplace transformation can 
be interchanged, the last equation can be written 



or, since the operator refers only to the variable 8, 



Now the specific result 



is known to us through independent reasoning Hence, we have 
finally 

i P'S 


which, except that the variable of integration is z instead of s, 
is exactly Eq. (2). From this result it is clear that the inversion 
integral is a line integral in the complex plane^ taken along a vertical 
line to the right of all the singularities of the transform ^{s) or along 
any other path into which this can legitimately be deformed. 

In the usual applications, the evaluation of the complex 
inversion integral is accomplished by the method of residues, 
using a semicircular contour whose diameter is the segment join¬ 
ing the points a — ib and a ib and whose radius b is large 
enough to ensure that all the poles of the transform are within 
the contour (Fig. 16.7). Specifically, we have th^ following result 
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theorem 1 

If 0 ( 5 ) is an analytic function of s except at a finite number of poles each of which 
lies to the left of the vertical line (R(s) = a and if s4>(s) is bounded as s becomes 
inhnite through the half plan^ (K(s) S a, then 

= 2 residues of at each of its poles 

PROOF Using the contour shown in Fig 16 7, we have, by tb^ residue theorem, 



ds -f- - -- f </)(s)e''* ds = y residues of 
Ja-ib ZTTt jCi 


1 fa-\-%b 

27r/ 


Hence, 

(4) 


-- f''^'^4t(s)e‘^ds — y residues of f <l>{s)f/Uis 

lirt Ja-ib L4 Iti JCt 


Now along C 2 we have 


s = a -h ^ ^ 0 ^ 


Stt 


and, for sufficiently large «, 

\8<f>(8)\ < M and |5 - a| ^ |5| + |al < 2|s 


Therefore, 


_ ^ l0(s)t *+•■*"*>iI 

- ^ l^/T I* " 




de 


^ 2Me‘' r'^'‘ e*'”"'' dS 

~ 2ir Jw/2 
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If we now set $ = ir/2 + a and then take advantage of the symmetry of the 
resulting integrand, the last integral becomes 

~ g-btaina gol g-fct iln a 

r Jo IT Jo 

Now it is evident from Fig. 16.8 that 



Hence the last integral is overestimated if we replace sin a in the exponent by t he 
smaller positive quantity 2a/v Doing this and then performing the integral ion, 
we have 



For I ^ 0, the last expression clearly approaches zero as h becomes infinite Hence, 
returning to Eq. (4), it is clear that 

^ - 9 ~; " *(«)«" 

Zirl Ja-ib Ziri Ja-%^ 

= £-M0(s)) 

= S residues of as asserted 

The proof of the last theorem breaks down if 0 ( 5 ) has in¬ 
finitely many poles, because then, as 6 —> 00 , there will always be 
semicircles C 2 on which |5(/>(«)1 is not bounded However, by 
choosing a sequence of semicircles whose radii become infinite 
and no one of which passes through a pole of <^(8), it is possible 
to show that the result of the last theorem is still valid in the case 
when 4>{s) has an infinite number of poles.* 


What is 


EXAMPLE 1 
1 


[(s -h a)* + 6*) 

Using Theorem 1, we have only to compute the residues of 


(« -H a)« -i- 6* 


* For a more detailed discussion of this point see, for instance, R V Church¬ 
ill, "Operational Mathematics," 2d ed., pp 190-193, M Graw-Hill Book 
Company, New York, 1958. 
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THI COMPLEX INVERSION INTEGRAL 


ns 


at its two first-OTder poles a ± ib At s ■■ + ifc, we have for the residue 


lim 


[g ~ (—Q + i5)]e^ 




•-»—a+*6 [« — (—a -f- i6)lf8 — (—a — i6)] 2i6 

and, at 8 " —a — ib, we have for the residue 

_[8 - (-0 - e^-a-^b)t 

#-»-o-*b [fi “ ( —a + i 6)1[8 — (—o — i6)] —2tb 
Hence, by Theorem 1, 

*(—o+i6)l «(—a—rf6)l 

fit) - J3-M«(.)l - ^-- 

2»6 -2ii 

gtbt — 


2tb 

e"®* sm W 


This example, of course, has been merely a new approach to 
a result with which we were already familiar. However, in more 
difficult applications the use of the complex inversion integral 
and contour integration is often either the only or, at least, the 
best way of finding a function when its transform is known 


What is , 


EXAMPLE 2 

Ir 


.i8£->r-—I? 

[ 8 cosh 08 J 

Obviously in this case the function has a first-order pole at 8 — 0 Moreover, since 
cosh 08 “ cos to8 (Eq (13), Sec. 14 7], it follows that has infinitely many other first-order 
poles, namely, the points where 

(2n - l)7r 


( 2 n - 1 )t 

108 ■» ± -—- or 


2ia 


n - 1, 2, 3, 


However, if we set s — <t 4- lu, we have, by Eq (17), Sec 14.7, 


| 80 ( 8 )| - 


1 


cosh 08 


_ 1 _ 

cosh* ao COB* au -h sinh* aa sin* ow 

1 


cosh* cur — sin* ata 

and this is bounded on any semicircle which does not pass through one of the poles of <>(8). 
Hence, the inverse of ^s) is simply the sum of the residues of 


8 cosh 08 


at each of its poles, i e., the poles of «K«) 
At a — 0 the residue is 


r ^ 

lim —;— 
«-»0 cosh 08 


- 1 


and, at 8 M ^ [using I'Hospital’s rule and Eq (20), Sec. 14 7, to evaluate the inde- 

2ta 
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terminacy], the residue is 


[a — (2n — l)ir/2iale*‘ 
lim - 


g(*n-l)»</lio 


(2n-l)ir 

2ta 


s cosh as 


(2n — 1)t (2n — l)ir 

- a sinh -- 

2ia 2i 

2 ( — 

" (2n - l)ir 

Similarly, at a --» the residue is 

2ta 

2( — l)ng-(an-J)rt/Ua 
(2n - l)ir 

Hence, pairing the terms which correspond to the same value of n, 

f(t) - £-M0(«)| - 1 + - y 

IT 2n — 1 
n-l 


1 -h 


4 y (-1)" 

X w 2n — 1 


(-I)" {2n - Dirt 

COB - 


2a 


EXERCISES 


Using the complex inversion integral, find the inverses of the following Laplace transforms In 
each case discuss the resemblance of the method of residues to the use of the Heaviside expansion 
theorems (Sec 7 5) 


1 

8 

6 

7 

9 


1 

(a + l)(a +3) 
1 

a* + 4 
1 

1 ) 


(a* + 4)» 
a + 1 

(a 4- 2)*(s + 3) 


2 

4 

6 

8 

10 


1 

a 

a» + 4a -h 13 
a 

a* -h i 

_ 1 _ 

(a* + 9) (a* + 4) 

1 _ 

2a -h 5)^ 


11 Complete the solution of Exercise 8, Sec 8 7, by finding the angular displacement at fi 
general point i 

Find the inverse of each of the following transforms 


12 


1 

a ainh aa 


18 


1 

(a +6) cosh as 


14 


sinh X yj a 
a sinh 


16 


Ujry/ a) 
8/o(\/ a) 


» where /o is the modified Bessel function of the first kind, 


16.4 

Stability criteria 

In the analysis of many physical systems a complete description 
of the behavior of the system is unnecessar and all that 
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required is a knowledge of whether or not the system is stable, i.e., 
whether its response to a bounded excitation remains bounded or 
becomes infinite as t —► <x>. As we shall see in this section, this 
question can be answered by analyzing the Laplace transform of 
the response without actually determining the response itself. 

We begin by supposing that, by methods such as those we 
described in Chap, 7, we have obtained the Laplace transform 
of the response of the system JC| 2 /( 0 ) s <^( 5 ) and that 0 (a) is a 
rational function; i e., 


0(8) = 


Pis) 

Qis) 


where P and Q are real polynomials in the complex variable 
8 = a tcj. Now we know from algebra that any polynomial, such 
as Qis), can always be factored into real linear and quadratic 
factors that may or may not be repeated Moreover, we know from 
the Heaviside theorems (Sec. 7 5) that the form of the inverse 
y{t) = £ ’( 0 (s)l is determined completely and solely by the 
factors of Q(s) and that the only terms which can possibly occur 
in it are the following 



Factor 

Term 



From unrepeated factors 

1 

8 

1 

2 


COB bt, sin ht 

3 

8 — a 


4 

(» - a)> + 

e®' cos bt, e“‘ sin bt 



From repeated factors 

.5 

j?", n > 1 

t*,0<k^n-l 

6. 

(jj’ -h n > 1 

cos bt, tf^ Bin bt, 0 < k ^ n — 1 

7 

{8 — 0 )"*, n > 1 

<*c®‘, 0 < A: ^ n — 1 

8 

[(« - a)2 + 62J", n > 1 

1 cos btj Bin bt, 0 < k ^ n — 1 


Clearly, terms of the forms 1 and 2 are stable in all cases, for, 
although they do not approach zero as f «, they do remain 
finite. Terms of the forms 3, 4, 7, and 8 are stable if and only if a 
is negative, in which case they’not only remain finite but in fact 
approach zero a.s ^ ► 00 Terms of the forms 5 and 6 are unstable 
in all cases, since, because of the factor t, each becomes unbounded 
as < — ► 00 . Translating these observations into conditions on the 
roots of the polynomial equation Qis) == 0, we see that the response 
y{t) will be stable if and only if the following conditions are met- 

a Every unrepeated real root is nonpositive, 
b Every repeated real root is negative, 
c Every pure imaginary root is unrepeated, 
d Every general complex root has negative real part. 
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Geometrically speaking, these conditions can be descnbed as 
follows. 


THEOREM 1 

In order for the function 

to be stable, it is necessary and sufficient that the equation Q(s) = 0 have no roots 
to the right of the imaginary axis in the complex s-plane and that any root on the 
imaginary axis in the s-plane be unrepeated 

Various methods are available for determining whether or nol 
the roots of a polynomial equation all have nonpositive real parts * 
In general, however, these are more conveniently formulated as 
methods for determining whether or not the roots all have real 
parts that are strictly negative, and most, though not all, of our 
results will be of this nature This is not a serious disadvantage, 
because in practice zero roots and pure imaginary roots, i e , 
roots whose real parts are zero, if they occur at all, are usualiy 
easily recognizable 

A preliminary result of considerable importance is contained 
in the following theorem. 


THEOREM 2 

The real part of each root of the polynomial equation Q{s) = 0 is less than or equal 
to zero only if the coefficients in Q{s) all have the same sign 

PROOF We observe first that it is no specialization to interpret the condition 
of the theorem as asserting that all coefficients in Q{s) are po.sitive For the 
case in which all coefficients are negative can be converted into the case 
in which all coefficients are positive, and vice versa, simply by multiplying 
Q(s) = 0 by —1, which, of course, in no way alters the roots of this equation 
Now, if every root of Q{s) = 0 has nonpositive real part, then the only possible 
factors of ©(s) are of the forms 

s -f Ox and (a -F H- where a*, ^ 0 

Since these factors contain only nonnegative terms and since Q{s) is simply the 
product of a finite number of these factors, it is clear that every nonzero coefficient 
in (3(i}) must be positive, as asserted 

It is also clear from the preceding argument that, if every a 
IS positive, so that all roots of Q(s) = 0 have real parts stnctly 
negative, then there can be no zero coefficients in Q(s); i.e , all 
terms must be present Hence, restating this observation con- 
trapositively, we have the following corollary 


* See, for instance, A Bronwell, “Advanced Mathematics in Physics and 
Engineering/’ pp. 386-413, McGraw-Hill Book Company, New York, 1953, 
and E A. Guillemm, “The Mathematics of Circuit An- yaiB,” pp. 395-409, 
John Wiley & Sons, Inc , New York, 1953 
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COROLLARY 1 

If one or more terms are missing from Q(s), then the equation ^(s) = 0 has at 
least one root whose real part is nonnegative. 

The condition of Theorem 2 is only a necessary and not a 
sufficient one, that is, it cannot be asserted, conversely, that, if the 
coefficients in Qis) all have the same sign, ther* the real part of 
each root of Q(s) = 0 is noiipositive. For instai ^e, 

8* + 8* -h ll8 -h 10 

contains only terms with positive coefficients, yet the roots of the 
equation 

8^ + 8* -h 8* + ll8 4- 10 = 0 
are 8 = — 1, — 2, I ± 2? 

and the two complex roots have positive real parts On the other 
hand, it is clear from Theorem 2 that we do have the following 
result 

COROLLARY 2 

If Q{8) contains some terms with positive coefficients and some terms with negative 
coefficients, then the equation Q(s) =0 has at least one root whose real part is 
positive 

For quadratic equations the necessary condition of Theorem 
2 18 also sufficient. For if the equation aos'^ -I- ai8 -h flz = 0 con¬ 
tains no negative coefficients, then its roots 

— Oi ± — 400^2 

8 

Zdi) 

are clearly either nonpositive real numbers or conjugate complex 
numbers with nonpositive real parts 

For cubic equations, a sufficient condition, .supplementing 
Theorem 2, is contained in the following result 

theorem 3 

A. necessary and sufficient condition that every root of the cubic equation 
4 - ai 8 * + 028 4 - 03 = 0 have negative real part \s that all coefficients have 
the same sign and that OiOz — > 0 

PROOF Let us assume for definiteness that the given equation has one real 
root r and one pair of conjugate complex roots p ± iq. The case in which the equa¬ 
tion has three real roots can be handled in exactly the same fashion From algebra 
we recall that the roots, say ri, rs, r*, of any cubic equation are related to the 
coefficients through the equations 

— = -(r, 4- r 2 4- ra) 

Go 

— = rir2 + r-iTi r^ry 
do 

52 

do 


—rir2r3 
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In the present case these become 

(1) ^ = -{r + 2p) 

(2) ^ + 2pr 

Oo 

(3) — = -r(p» + g^) 

do 

From (3) and the assumption that the a's all have the same sign, it follows that 
r < 0 To prove that p < 0, we note that the condition aia-i — aoan > 0 can be 
rewritten, after division by aj, as 
Q] 0-2 > Q 

CLq do do 

When the ratios of the a's are replaced by their equivalents from (1), (2), and (3), 
this becomes 

- (r -h 2p)(p2 2pr) -}- r(p2 -j- > o 

or, simplifying and rearranging, 

(4) — 2p[(p^ -h + 2pr) -H > 0 

Now from (2) and the hypothesis that the a’s are all of the same sign, it is evident 
that 2pr > 0 Hence, (p* + q"^ + 2pi) -f r'^ > 0, and it follows from 

(4) that p < 0, as asserted This proves the sufficiency of the conditions of 
Theorem 3. 

The necessity that all the coefficients have the same sign follows immedialch 
from (1), (2), and (3), since the right-hand sides of these relations arc all poMtn e 
if p < 0 and r < 0 The necessity of the condition a\a 2 — (IqCl^ > 0 follows b> 
reversing the above steps and working backward to this inequality from (4), 
which is surely true if p < 0 and r < 0 

The extension of Theorem 3 to polynomial equations of higher degree 
contained in the next theorem, which we state without proof.* 

THEOREM 4 

In the polynomial equation 

Q{8) = ao5” -h d\s^~^ + -f- -f- On-is -|- On = 0 

let every coefficient be positive, and construct the n quantities 






ai 

do 

0 

Di = ai 

D2 = 

Cli do 

D, 

= fla 

02 

Oi 



O3 02 









Os 

04 

aa 

a, 

<*■0 

0 

0 

0 

0 


aa 

da 

Oi 

Oo 

0 

0 


Dn = as 

di 

03 

O2 

Oi 

Oo 


a2n—' 

l fl2n-2 

02n-3 

fl2n-4 

a2n-h 

a2n- 

-« 


* See, for instance, J V. Uspensky, “Theory of Equati ms," pp 304-309, 
McGraw-Hill Book Company, New York, 1948 
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’vhere, in each determinanl, all a's with negative subscripts or with subscripts 
greater than n are to be replaced by zero. Then a necessary and sufficient condi- 
tion that each root of Q(s) = 0 have negative real part is that each Bn he positive. 

This IS commonly known as the Routh or Routh-Hurwitz stability 
criterion. 


EXAMPLE 1 


For the equation + s + 2 - 0, we have 






1 

t 1 


i ] 

1 

0| 

D, - 

1 

D 

2 “ 


7), 

" 1 ^ 

2 

] 








1 ^ 

1 

1 


1 

1 

0 

0 



1 1 

0 

0 


1 

2 

1 

1 



1 2 

1 

1 

7)4 “ 

2 

1 

1 

2 

- -4 

D, - 

2 1 

1 

2 


0 

0 

2 

1 1 



0 0 

2 

1 







1 

0 0 

0 

0 


Since not all of the D’s are positive, the given equation has at least one root whose real part is 
nonnegative This ran be eonfirined, of course, by actually finding the roots of the given equa¬ 
tion, which are, m fart 


r. --1 r„ rj - Vii ± I ^3/2 r,, r,-4 ± i \/7/2 


A somewhat rliffcretit method of obtaining information about 
the location of the roots of an equation/(z) = 0, which has the 
advantage that it tells exactly how many roots there with 
positive real parts and, moreover, is not restricted to the case 
where/(z) is a polynomial, is based on the following theorem. 


theorem 5 

IS analytic within and on a closed curve C except at a finite number of poles 
and if/(z) has neither poles nor zeros on C, then 


2vi 


Jc 


'm 

'c f(z) ‘ 


N - P 


where N is the number of zeros of f(z) within C, and P is the number of poles of 
f(z) within C, each counted as many times as its multiplicity. 


PROOF Suppose first that, at a point / = ak within C, f(z) has a zero of order 
Then/(z) can be written 


f(z) = (z - ak)^'‘<t>iz) 


where is norivanishmg and analytic m some neighborhood of z = ak. From 
tins f'(z) = nk (2 - + {z - ak)’‘.<j>'(z) 


thus 


f{z) _ rik iz - -h (z - ^ 

/(z) “ (z - aky>>4>{z) z - ak 


+ 


4>{z) 


f^mce 0(z), and hence </)'(z), is analytic at z = o* and since 0(z) does not vanish at 
^ = ak, the fraction 0'(z)/<^(z) is analytic at z = a* Hence it is clear from the last 
^^pression that f'(z)/f{z) has a simple pole with residue n* at every point ak 
where/(z) has a zero of order rik. Similarly, if/(z) has a pole of order p* at the 
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point z = bky we can write 


m = 


^-Pk _I_ + 1 _. .1 -1- /. _L 

(2 - (2 - z - 6fc 


C_1 


Hence, putting these fractions over a common denominator, we have, in the 
neighborhood of z = 6*, 


/(«) = 


1 


where ^(z) = c_p, + c_„+i(z — bt) + c_„+j(« - bt)^ + ■ 

is obviously analytic and nonvanishing at « = bt. Therefore, around 6*, 
f'(z) = -Pl(2 - 6 *)-'>‘-V'(z) + (z - 

J .U /'(*) ~P*(* ~ bt)-’’>-^<l/{z) + (2 - bi,)-’“if'{z) -Pk , i'{z) 

and thus = - lz--b,r^^f(z) = T- 6* + J(z) 

The last fraction on the right is clearly analytic; hence, f{z)/f{z) has a simple 
pole with residue — p* at every point where/(z) has a pole of order p* Applying 
the residue theorem to/'(z)//(z) over the region bounded by C, we therefore have 


dz = 2Tt ^ residues = 2vi ^ P^) “ 27n(N — ^ 

since Sn* is the total multiplicity N of all the zeros of/(z) within C and Sp* is the 
total multiplicity P of all the poles of /(z) within C. Dividing by 27rz, we obtain 
the assertion of the theorem. 


An important alternative form of the last theorem can be 
derived by noting that 

S-./cM*-55/c 

Hence, performing the integration, 

N — P = [variation of ln/(z) = In |/(z)| i SiTgf{z) 

/net 

in going completely around T] 

Clearly, In |/(z)l is the same at the beginning and at the end of 
any closed curve, and therefore 

N - P = [variation of i arg/(z) around C] 

Zirl 

_ variation of arg /(z) around C 
2w 

In particular^ if f(z) is analytic everywhere within C (so that 
P = 0), we have the following important result, commonly known 

as the principle of the argument: 


COROLLARY 1 

If/(z) 18 analytic within and on a closed curve C and does not vanish on C, then 
the number of zeros of/(z) within C is equal to l/27r times the net variation in the 
argument of/(z) as z traverses the curve C in the counterclocl yviae sense. 
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Ill Reometric terms, this means that, if the locus of i/; = f{z) is 
plotted for values of z ranging around the given contour C, then 
the number of times this locus encircles the origin in the tc-plane 
IS the number of zeros of f(z) within (\ Moreover, since/(z) = 0 
implies w; = 0, it is evident that if f(z) has a zero on the image 
curve passes through the origin in the ly^-plane 

To use the last t heorem and its eorollary to determine whet her 
or not each of the roots of a polynomial equation Q{z) = 0 has 
negative real part, we proceed as follows In the 2 -plane let the 
contour C consist of the segment tlir imaginary axis between 
— R and R and the semieircle lying in (he right half plane and 
having tins segment as diameter O'lg. 16.9) Since a polynomial 
equation has only a finite number .'f roots, it is clear (hat, if R is 
taken suftieiently large, any root.^ of Q{z) 0 which Jie ui the 
right half plane, i e . any roots winch liave positive rcLil par(s, 
will lie within C 

R 

FIGURE 16 9 

4 scniK'irrular 
contour 

all zeros of a 1 unc¬ 
tion which lie in 
the riKht half 
plane 

- R 

Now let z range over the contour C and in an auxiliiirv w~ 
plane let the locus of the corresponding valutas of v' Q(z) be 
plotted If this curve does not enclose* the origin in the w;-plane, 
then aee.ording to the corollary of Theorem .5, Q{z) - 0 has no 
roots in the right half plane If, furtliei, this curve docs not pass 
through the origin in the ^c-plane, tlier Q(z) -- 0 has no roots on 
(he imaginary axis cither, i e , all loots of — 0 have negative 
real parts On tlie other hand, if the image e.urve encircles the 
origin in the iz'-plane a net number ot times k, then Q( 2 ) — 0 has 
k roots in the right half plane, i e , has k roots with positive real 
part Moreover, for every time this curve passes through the 
ongin in the le-plane there is a root of Q{z) -= 0 lying on the 
imaginary axis in the 2 -plane Dislinet pure imaginary roots of 
Q( 2 ) = 0 thus give rise to a multiple point at the origin in tlie 
le-plane, the tangents at the multiple point being distinct A 
repeated pure imaginary root in the 2 -plane similarly gives rise, 
in general, to a cusp at the ongiii in the iz?-plane 

The labor of plotting the image curve in the u^-plane can be 
reduced considerably by letting /?—>«> The image of the semi¬ 
circular portion of C then recedes to infinity in the le-plano, and 
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without any plotting, its contribution to possible encirclement,s 
of the origin can be determined as follows. On the semicircle wo 
have 

For the images of these values of z we have 

w = Q(Re^^) = ao{Re^^y -h + ■ • • + ctn 

Now, for arbitrarily large value.s of R, all terms in Q{Re'^) after 
the first are negligible in comparison with the first term 
Hence, as z traverses the semicircular portion of C in the pi^sitivo 
direction, with d = arg z varying from —ir/2 to 7r/2, the argu¬ 
ment of its image 

w = 

varies from — n7r/2 to mr/2, which represents a net variation m 
arg ic, that is, arg Q{z)y of mr Hence if ic = Q( 2 ) is plotted only 
for z varying from to —zoo along the imaginary axis and tli^ 
net change in the argument of w is rioted, with its proper sign, o( 
course, this change plus ut will give the nel change as the entire 
contour C is traversed. This change, divided by 27r, gives the net 
number of times the image curve encircles the origin in the w- 
plane, and this number is equal to the number of roots of Q{z) - 0 
m the right half of the 2 :-plane The labor of plotting can be still 
further reduced by noting that, for polynomials with real coeffi¬ 
cients, such as we encounter m Laplace transforms, we have 

0 ( 2 ) = W) 

and, hence, the plot of Q{z) for values on the lower half of the 
imaginary axis is ju.st the reflection in the real axis of the plot of 
Q{z) for values of z on the upper half of the imaginary axis 

EXAMPLE 2 

Disruss the stability of y{i) if £\y{l)] = (s* + l)/(s* -f 5* + 4s -f 1) 

As we pointed out above, the stability of yit) is determined solely by the location of the zeros 
of the denominator of y(t) Hence, we begin by plotting 

w - Q{8) - + s* + 4s + 1 

for values of s on the imaginary axis, i c , for s = tw and u ranging from « to — oo The para¬ 
metric equations of the image curve arc easily obtained, for 

Q(tu>) “ —loj® —, faj* -b 4i&> -|- ] 

and 80 the real and imaginary parts of w ^ u tv 

?/ ™ 1 — w* and r ■= 4w — «* 

Figure 16 10 shows a plot of this curve together with a plot of arg w Evidently, os s traverses the 
imaginary axis from i « to — i w, arg w vanes from Sn/'Z to —’6x12, which is a net variation of 
— 3ir ThiSj 'kdded to the value nr s 3ir contributed by the semicircular port n of the contour C 
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FIGURE 16.10 

Plots of Q(s) 
s* -f s* + 4« 
and arg Q(3) 

s * iw 




(Fig 16 9), gives a net variation of zero as the entire contour C is traversed. Hence, Q{s) has no 
zeros m the right half of the s-plane. Moreover, since the image curve does not pass through the 
origin in the t(;-plane, ^(s) has no zeros on the imaginary axis Therefore, by our earlier discus¬ 
sion, the inverse y(i) is stable 

EXAMPLE 3 

Discuss the stability of y(t) if £\yit )} - (a — 2)/(a* -j- a’ i- a -p 4), 

Proceeding exactly as in Example 2, we obtain from 

Qitta) —iw* — u* -p to» H- 4 

the parametric equations 

u * 4 — w* and i> — <«> — id> 

and the image curve shown in Fig 16,11 In this case, as a traverses the imaginary axis from i « 
to — t Qo, arg w varies from 3Tr/2, as in Example 2, to 57r/2, which is a net variation of 6ir/2 — 3ir/2 
*" IT Hence, adding the variation mr m 3ir contributed by the semicircular portion of the con¬ 
tour C (Fig 16 9), we obtain 4Tr for the net variation in arg w as the entire contour C is traversed. 
Dividing this by 2 t, we obtain 2 as the number of seros of 0(«) m the right half plane. The 
inverse in this case is, therefore, unstable 
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Theorem 5 finds its best-known application in the so-called 
Nyquist stability criterion, which is a modification of the preced¬ 
ing process especially well adapted to the stability analysis of 
closed-loop control systems. One common problem m engineering 
IS to make the output XoiO of a system follow quickly and accu¬ 
rately changes made in the input z,(0 to the system. In an open- 
loop system, such as that shown m Fig 16.T2a, this is often diffi¬ 
cult to accomplish; specifically, prolonged oscillation of XoiO 
about its desired value may well follow an abrupt change of the 
input Xt(t) to some desired new value One possible way to remedy 
this situation is to (construct a feedback loop, such as the one 
shown in Fig 1(3.126, which will sample the output and feed it 


FIGURE 16.13 

Systems with 
feedback loops 
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back to a differential device which will m turn transmit the error 
signal ^",(0 — Xo(t) as a modified or corrected input to the original 
system More generally, the output Xoil) may be a 7 id usually is 
modified by some additional device in the feedback loop to pro¬ 
duce the feedback signal x/(t) before it is fed to the differential 
(Fig. lf).12c) 

In Fig 16 12r, let Gi(s) and (72(s) be the transfer functions 
of the original system and the feedback loop, respectively. Then, 
from the definition of a transfer function as the ratio of the 
transformed output to the transformed input (Sec 7.7), we can 
write 

£|Xo(01 = Cr,(8)[£\x.{t)\ -£{Xf{t)\] 

£.{xf(t)\ = r; 2 (s)£U „(01 

If we eliminate £jx/(01 between these two equations, we obtain 
at once 


£lxo(0} 


0i(8) 

1 -h GMG,(s) 


£! x .(01 


Evidently f7i(5)/[l -j- 6ri(«)(72(s)] is the over-all transfer function 
of the entire closed-loop system 

The question of the stability of a feedback system is of great 
importance and, as we discussed above, can be answered by an 
examination of the Laplace transform of the output, namely, 


Oi(s) 

1 4- G,{8)G,{s) 


£{2;.(0I 


Now, if the original system without the feedback loop is stable for 
the input a*,(/), as we shall suppose, then the product f7i(s)£ lx,(0 j 
can have no poles in the right half of the «-planc, and the stability 
of the over-all system depends solely on the location of the zeros 
of the denominator, 


1 -f- Gi(s)G2{s) 

Hence, as before, we plot the locus of the function 

wis) = 1 -h Gi{s)G2{s) 

as a ranges over the contour of Fig 16 9. 

In this case, since Giis) and Gi(«) are themselves Laplace 
transforms, each approaches zei'o as R becomes infinite (Corollary 
1, Theorem 5, Sec. 7 1). Hence, the image of the semicircular 
portion of the contour C shrinks to the single point = 1 as 
R 00 . Thus, to determine stability, it is necessary only to plot 
Tii(«) = 1 + (7i(s)(72(fi) for values of a on the imaginary axis and 
determine whether or not the resulting curve encloses the origin. 
Moreover, as we pointed out above, this curve can be constructed 
simply by plotting 1 4- Giiiw'JGiitw) for positive values of w and 
then reflecting the resulting arc in the real axis. In practice, 
instead of plotting u; 1 4“ Gi(ta))Gs(iw) and observing whether 
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or not the image curve encircles the origin, it is customary to 
plot w = 2(1(13) and observe whether or not it encircles 

the point w = — 1 . The equivalence of these two procedures is 
obvious. 

It would take us too far afield and involve us in too many 
details of a purely engineering nature to discuss the application 
of the Nyquist stability criterion to specific, nontrivial closed- 
loop systems. Such applications appear in large numbers in books 
on servomechanisms, and to these we must refer for illustrations 
and further information.* 

EXERCISES 

Using the geometric approach based on the corollary of Theorem 5, determine whether nr 
not the following equations have any roots with nonnegative real parts Check by using 
Theorem 4 

1 + « + 9 - 0 2 a* + -f 10« + 6 - 0 

8 a* + 28> 4- 7s> + 4fl + 10 - 0 4 a* + + a* + lOs -h 10 - 0 

8 Prove Theorem 3 on the assumption that the cubic has three real roots 


* See, for instance, G J Thaler and R G Brown, '^Analysis and Design 
of Feedback Control Systems,'^ 2d ed , McGraw-Hill Book Company, New 
York, 1960, or H Chestnut and R W Mayer, “Servomechanisms and Regu¬ 
lating System Design,” John Wiley & Sons, Inc , New York, 1951 
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The geometrical representation of functions of z 

Although in the last section we plotted the values of a function 
~ fi^) for certain values of z, namely, those on a particular 
semicircular contour, we have not as yet attempted to provide a 
geometrical representation for w = }{z) when z ranges over the 
entire complex plane To do so now requires a decided ^^eparture 
from the conventional methods of cartesian plotting, which 
associate a curve with a real function y — g{x) and a surface with 
a real function z = h(x^y) In the complex domain, a functional 
relation w - f{z)y that is, 

u IV = f(x + ly) 

involves four real variables, namely, the two independent variables 
X and y and the two dependent variables u and v Hence, a space 
of four dimensions is required if we are to plot w = f{z) in the 
cartesian fashion To avoid the diflici’lties inherent in such a 
device, we choose instead to proceed as follows' 

Let there be given fwo planes, one the z-plane, in which the 
point z = X ly 18 to be plotted, and the other the ic-plane, in 
which the point u H- is to be plotted. A function w = f{z) is 
now represented not by a locus of points in a space of four dimen¬ 
sions but by a correspondence between the points of these 
two cartesian planes. Whenever a point is given in the z-plane, 
the function w = f(z) determines one or more values of u -f it; 
and, hence, one or more points in the la-plane. As z ranges 
over any configuration in the 2 -plane, the corresponding point 
u -j- IV describes some configuration in the ic-plane. The function 
w ^ f{z) thus defines a mapping or a transformation of the 
2 plane onto the le-plane and, in turn, is represented geometrically 
by this mapping. 
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EXAMPLE 1 

Dibcubs the way in which the z-plane is mapped onto the ic-plane by the function u; ** z* 

In this case w’e have u + ly « (x -f ly)^ — (i* — y^) -H 2ixy, and thus 

(1) u — X* — V* y — 2xy 

These are the equations of the transformation between the two planes From them, many 
features of the correspondence ran easily be inferred 

For instance, lines parallel to the i e , lines with equations x — Ci, map into curves m 

the Tc-plane whose parametric equations are, from (1), 

u = c\^ — y'i V ^ 2ciy 

Eliminatinf^ the parameter y, we obtain the equation 



This defines a family of parabolas having the origin of the ic-plane as focus, the line y = U as 
axis, and all opening to the left (Fig 17 1) Similarly, lines parallel to the x-axis, i e , lines with 



FIGURE 17.1 

Plot showing the mapping of certain lines by the function ic « z* 
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equations y “ Cs, map into rurvea in the wj-plane whose paranietne equations are 
u - T* - C2® e - 2eir 
Eliminating x, we obtain 



which 18 tlie equation of a family of parabolas having the origin as focus, the line c * 0 «s axis, 
but this time all opening to the right 

Mapping from the t/i-plane back onto the r-plane is even more immediate From fl), the 
lines u = ki correspond to the rectangular hyperbolas 
I* - 1/2 » k, 

The lines v “ /fa correspond to the rectangular hyperbolas 
xy = 1 2^2 

The imagtjs of other curves, or legioiis, can, with varying degrees of difficulty, be found m 
tlie same fashion For instance, to find the eiirve into \\hi(.li the line 

j/ - 2x + 1 


FIGURE 17.2 
Tlot illustrating 
the two-valued 
character of the 
mapping defined 
by z = 


z plane 



> 



X 



w plane 




x;:/ 
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ifl transformed, we must eliminate x and y between this equation and the equations of the 
transformation To do this, we first substitute for y in Eqs (1), getting 

u I* — (2i -f 1)’ ■ — — 1 

V — 2j:(2x -hi)— 4x® + 2i 
Solving these equations for x and x®, we find at once 

411 4- 3y + 4 u 2v \ 

X --7^^-- X® --7- 

Hence, 

or J6?v* + 24wi' 4- 9u® 4- — 16t» = 4 

which 18 the equation of a parabola 

Although w IS a single-valued function of 2 , the converse is not true In fact, when w is given, 
z may be either of the two square roots of w Because of this, the mapping from the z-planc to 
the le-plane covers the latter twice, as Fig 17 2 shows This, of course, is nothing but a grapliir 
representation of the now familiar fact that the angles of eomplex numbers are doubled when the 
numbers are squared 

EXERCISES 

1 Discuss the mapping between the z- and le-planes defined by the function w = (2)® 

2 Discuss the transformation between the z- and te-planes defined by w ^ x — ty 

3 What relation, if any, exists between the transformations w — f{z) and w = /(2)'^ 

4 Discuss the transformation defined by w =« 2tz 4- 1 

6 Discuss the transformation defined hy w *= (x® — y®) 4" ixy In what significant way does it 
differ from the transformation defined by w = z* «= (j® — y®) -f 2ijy'^ 

0 Disrubs the transformation defined hy w — z^ Plot the image of the line n =» 1 What is 
the equation of the image of the line x = 1? 

7 Discuss the transformation defined by w; ^ z* Plot the image of the line w = 1 What is the 
equation of the image of the line x = 

8 Discuss the transhirmation defined by the function lu “ 1/r Plot the image i»f the square 

whose vertices are the points 2 1 -f i, 2 -f z, 2 4- 2i, 1 -|- 2i 

9 J'lnd the equations of the transformation defined by tlie function (2 — i)/z, and show that 
every circle through the origin in the 2 -plaiie is transformed into a straight line in the le-plane 

10 Discuss the transformation defined hy w = e* What is the equation of the image of the line 
I 4 - y - 1? 


u 4- 2i; 4- 1 / 4u -h Si; 4 - 4^ 

5 ” V -10 / 


17.2 

Confonnal mapping 

In the last section we saw that every function of a complex var¬ 
iable maps the xy-plane onto the wt'-plane We now propose to 
investigate in more general terms the character of this trans¬ 
formation when the mapping function u‘ = u{Xjij) 4- tv(x,y) 1 -"' 
analytic. 

At the outset it is important to know when the transformation 
equations can be solved (at least theoretically) for x and y 
single-valued functions of u and v] that is, when the transforma¬ 
tion has a single-valued inverse. The condition h r this, as estab- 
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lished in most texts on advanced calculus,* is simply that the 
Jacobian determinant of the transformation, 
du du 
dx dy 
dv do 
dx dy 

be different from zero. Since tv = fiz) is assun.^d to be analytic, 
u and V must satisfy the Cauchy-Riemann equations. Hence, 
substituting into the Jacobian, wo hav^e 
I dll dv I 



which establishes the following result’ 



THEOREM 1 

If/(z) is analytic, the transformation w = f{z) will have a single-valued inverse 
in the neighborhood of any point where the derivative of the mapping function is 
different from zero. 


Exceptional points where f'{z) = 0 are known as critical points 
of the transformation 

Now consider a value z and its image w = fiz), where/(z) is 
analytic, and let 


Az = |A 2 |c‘® and Aw = 

be corresponding increments of these quantities (Fig 17.3) Then 
Aw _ I /l-iH ,(* 


f'(z) = lini 

Az 


lim 

»0 


From this it is apparent that 

hm ^ |/'(z)| and lim (0 - 0) = arg f ( 2 ) 
At --0 \Az\ 

or, to an arbitrary degree of approximation, 

(1) |Au;| ^ \f{z)\ lAzj 

and 0=0 + arg/'( 2 ), or 
(“) arg Aw = arg Az + arg f'(z) 


figure 17 3 
l^lot showing Az 



find its image Aw 

A- 


Under a mapping 

W I 

" 


• See, for instance, R C Buck, "Advanced Calculus," p 215, McGraw-Hill 
Book Company, New York, 1956. 
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Now the fact that/'(r) exists [which, of course, it does, since 
/(z) is assumed to be analytic] means that both |/'(z)| and SLTgf(z) 
are independent of the manner in which Az —^ 0. In other words, 
they depend solely on z and not on the limiting orientation of the 
increment Az. Hence, from (1) we draw the following conclusion 

THEOREM 2 

In the mapping defined by an analytic function w = f(z), the lengths of infini¬ 
tesimal segments, regardless of their direction, are altered by a factor \f'{z)\ 
which depends only on the point from which the segments are drawn. 

Since infinitesimal lengths are magnified by the factor \f'{z)\, it 
follows that infinitesimal areas are magnified by the factor 
|/'(z)|^ that IS, by J{u,v/x,y) 

Similarly, we conclude from (2) that the difference between 
the angles of an infinitesimal segment and its image is independent 
of the direction of the segment and depends only on the point 
from which the segment is drawn In particular, two infinitesimal 
segments forming an angle will both be rotated in the same direc¬ 
tion by the same amount, hence, the measure of the angle between 
them will in general be left invariant by the transformation 

However, when/'(z) = 0, arg/'(z) is undefined, and we can¬ 
not assert that angles are preserved. To investigate this case, 
suppose that/'(z) has an n-fold zero at z = zo. Then/'(z) must 
contain the factor (z — zo)", and, hence, we can write 

f'(z) = (n + l)a(z - Zo)” -h (n + 2)b(z - zo)”"^^ -h 

where a, h, . are complex coefficients of no concern to us and 
the factors n -|- 1, n -|- 2, . have been inserted for conven¬ 
ience in integrating/'(z) to obtain/(z). 

/(z) = /(zo) -h a(z — zo)""*'^ + h{z - zo)”+^ + • 

If in this expression we transpose/(zo), set 

z — Zo = Az /(z) — f{zo) = Aic 

and divide by a(Az)"‘‘'', we obtain 

= 1 + - Az + • 

As Az —► 0, the right member approaches 1 Therefore, 
lim (arg Aw;) — lim arg a(Az)"'*‘^ = arg 1=0 

At—>0 Af—»0 

or, to an arbitrary degree of approximation, 
arg Au; = arg a + (n + 1) arg Az 

Now let Azi and Azj be two infinitesimal segments which make an 
angle 6 with each other, and let Awii and AWa their images. 
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From the last expression we have 
arg Au>i = arg a -f (n -|- 1) arg Azi 
arg Aw ?2 = arg a 4- (n -h 1) arg Az^ 

Hence, subtracting, 

arg Aw 2 — arg Awi = (n -|- l)(arg Azg — arg = (ti -h l}i9 
Thus we have established the following theorem 


theorem 3 

In the mapping defined by an analytic fun'^tion w; — f{z), angles fire in general 
preserved in magnitude and in sense The only exception to this occurs when the 
vertex of the angle is an n-fold zero oi f'(zi, in which ease the angle is altered Vy 
the factor n -h L 

Example 1 of the last section is an excellent illustration of 
the behavior described by Theorem 3 The mapping function 
w = f(z) is everywheie analytic, and, as Fig 17 I indicates, 

angles are in general preseived However, the derivative /'(sr) = 2z 
has a simple zero at 2 — 0, and, as Fig 17 2 indicates; angles with 
vertex at the origin are not preserved, but instead are doubled. 

A transformation which preserves the magnitudes of angles 
is said to be isogonal. A transformation which preserves the sense 
as well as the magnitudes of angles is said to be conformal. If 
f(z) is an analytic function, it follow.s from Theorem that, m 
the neighborhood of any point where/^^) 0, the transformation 
defined by w — f{z) is conformal Conversely, it can be shown* 
that, if the mapping 

u = u(x,y) V = v(x,y) 

is conformal and if the first partial derivatives of u and v are con¬ 
tinuous, then w = u -b IV = f(z) is an analytic function. Because 
of the properties guaranteed by Theorems 2 and 3, it is clear that 
under a conformal transformation any infinitesimal configuration 
and its image conform^ m the sense of being approximately sim¬ 
ilar. This is not true, however, for large configurations which may 
bear little or no resemblance to their images 

One important reason foi studying conformal transformations 
IS that solutions of Laplace’s equation remain solutions of Laplace’s 
equation when subjected to a conformal transformation More 
precisely, we have the following theorem: 


theorem 4 

If 0(x,i/) is a solution of the equation 


dx* dy^ 


* See, for instance, E. G Phillips, “Functions of a Complex Variable," pp 
35, 36, Interscience Publishers, Inc , New York, 1946. 
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then when 4>(x^y) is transformed into a function of u and z; by a conformal trans¬ 
formation, it will satisfy the equation 


aV 

au* 


+ ft - 0 

dv^ 


everywhere except possibly at the images of the points where the derivative of the 
mapping function is equal to zero 


PROOF Let w = u{x,y) + iv(x,y) define a conformal transformation by means 
of which <p{x,y) is transformed into a function of u and v Then 

d<f> _ a 0 dll d<f> dv j d<f> _ d<l> du d<f> dv 

dx du dx dv dx dy du dy dv dy 

A second differentiation of each of these yields the results 

d^4> _ 1 / d^<f> ay\ du d(t> d^v / d^4> da d^<f> ai’X dv 

dx^ du a.r^ \du‘^ dx dv du dxj dx dv dx^ yda dv dx dv^ dx) dx 

d^4> _ dii> a^u /a ^0 du d'^4> dv\ du dif) dh / a *0 du d^<^ dv\ dv 
dy^ du dy’^ \ai /,2 dy du dy) dy dv dy- \aw dv dy dv"^ dy) dy 

When these are added, we obtain 

aj* dy'^ awyaj^ dy"^) a?/^[\ax/ \^y) J 

a ^0 /du dv du aA I a^A a^^ r / arV / a 7 ;Y 

aa ar\ax aj ^ydy) ac^aj:^ dy'\) ai;^[\axy \dy/ 

Since vj = u tv is analytic, by hypothesis, u and v themselves satisfy Laplace’s 
equal ion Hence, the first and fourth groups of terms on the right vanish iden¬ 
tically Moreover, u and v also satisfy the Cauchy-Riemann equations, hence the 
third group of terms also vanishes identically Using the Cauchy-ILemann criua- 
tions again, what remains can be written 

a20 a^^ ^ 4 ^ 

dx^ dy^ du^ L\W \ J LV^-^/ Vd^v _ 



Thus, at any point where the transformation is conformal, that is, where/'( 2 ) ^ 0, 

+ = 0 iniphes a-, + -^» = 0 as asserted 

Suppose now that it is required to solve Laplace’s equation, 
subject to certain boundary conditions, within a region R. Unless 
R IS of a very simple shape, a direct attack upon the problem will 
usually be exceedingly difficult. However, it may be possible to 
find a conformal transformation which will convert R into some 
simpler region R\ such as a circle or a half plane, in which 
Laplace’s equation can be solved, subject, of course, to the trans¬ 
formed boundary conditions. If this is the cas , the resulting 
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solution, when carried back to R by the inverse transformation, 
will be the required solution of the original problem. 

EXERCISES 

1 a What 18 the length of the curve into which the upper half of the circle \z\ - a is trans¬ 
formed by the function w * l/z? (b) What is the length of the arc into which this function 
transforms the segment of y « 1 — x which lies m the first quadrant' 

2 What 18 the area of the region into which the square with vertices z “ y>, 1, 1 i, i is trans¬ 
formed (a) by the function tv - z*? Cb) by in * 

3 a What are the critical points of the transformation w - z"? (b) What is the locus of 
points at which the magnification is 1? What is the locus of points at which infinitesimal 
segments are rotated (c) through 45“? (d) through 90"? 

4 Are there any points at which infinitesimal segments arc left unchanged in magnitude and 
direction by the transformation — z* -h z"? 

6 If w “ 2x* -h J/* a,nd v “ j/’/i, show that the curves u « constant and v = constant cut 
orthogonally at all intersections, but that the transformation defined by /(z) = u + iv is 
not conformal Give a specific illustration of the latter fact 


17.3 

The bilinear transformation 

The simplest class of conformal transformations, yet one of the 
most important, is the class of bilinear or linear fractional or 
Mdbius transformations/ defined by the family of functions 

(1) to “ ad — be 0 

cz -j- a 

The restriction ad — be ^ 0 is necessary because, if ad = be, then 
a/c = b/d and the numerator and denominator of w are propor¬ 
tional As a consequence, w? is a constant independent of z, and 
thus the entire 2 -plane is mapped into the same point in the 
te-plane^ 

It is convenient to investigate the general bilinear trans¬ 
formation by considering first the three special cases 

a w = z \ 

b w = ^iz 

C = l/z 

In case a, w is found by adding a constant vector X to each z. 
Hence the transformation is just a translation m the direction 
defined by arg X through a distance equal to |X| In particular, we 
note for later use that this rigid motion necessarily transforms 
circles into circles. 

In case b, w is found by rotating each z through a fixed angle 
equal to arg and then multiplying its length by the factor \n\. 


Named for the German geometer A F. Mbbius (1790-1868). 
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In this CEise, too, circles are transformed into circles. To prove 
this, let us first write the equation of the general circle 

a(x* H- v*) -h -h cy + d = 0 a, 6, c, d real 6* + c* ^ 4ad 

m terms of z and I by means of the relations 


z + 2 

^ = —TT- 



— zl 


The result is azz + - z z + d = 0 


or, renaming the coefficients, 

{A -b A)z2 + Bz “b + (Z) -b D) = 0 


where now A, B, and D can be arbitrary complex numbers, sub¬ 
ject to the condition BB ^ (A -b A)(Z) -b .D), derived from the 
condition -b ^ 4ad, which ensures that the radius of the 
circle is real. If the substitution 


w 

z = — 

is made in (2), we obtain the transformed equation 
(A -f + + (D + i>) =0 

MM M M 

or 

(A + A)iuw -b {Bp)w -b -b (Z) -b t>)yLfi = 0 

Since the coefficients of the first and last terms in (3) are real and 
since the coefficients of w and w are conjugates, this equation has 
the same structure as (2) and, hence, will also represent a circle 
provided its coefficients satisfy the condition necessary for the 
radius to be real For (3), this condition is 

{Bfi){B^) ^ (A 4- A)(Z) -b 

or, dividing through by nfl, which is necessarily positive, 

BB ^ {A A)(D -f D) 

which is true by hypothesis. If a = 0, so that A -b A = 0, both 
the given circle and its image reduce to straight lines 
In case c we can write 

1 z 

ui = - = ~ 
z zz 


which shows that w is of length l/\z\ and has the direction of i- 
To describe the geometrical process by which a point with 
these characteristics can be obtained from a given point z, we 
must first define the process of inversion. Let C be a circle with 
center 0 and radius r, and let P be any point m the plane of C 
Then the inverse of P with respect to C is the joint P' on the 
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ray OP for which 
(5) OP • OP' = 

From the symmetry of this relation it is clear that P is also the 
inverse of P' Geometrically, a point and its inverse are related as 
follows P>oin any point P outside a circle (' with center O le| 
the two tangents to C be drawm, and let the points of contac't of 
these tangents be joined (Fig 17 4) The intersection of this chord 


FIGURE 17.4 

Plot showing the 
geometrical rela¬ 
tion between a 
point and its 
inverse 



With the hne OP is the inverse P' of P (Conversely, \vi P' be any 
point in the interior of (' At P' eieci a pcijxnidicular to ()P\ and 
at the fioint wIk'K* tins nu*els P let the tangent to C be drawn 
The inters(‘(‘tion of ibis tMiigent and tin* line 01*' is tli(‘ inverse 
P of P' The consistency of these constructions with the definitive 
property (.'») is evident, since jn Fig 17 4 


and thus 
or 


AOP'T, --A07hP 

OP' ^ OTi 

or I OP 

OP OP' = (O'Ti)' ~ r 


It IS evident now that the constrintion of from z in (*ase c 
requires that the inverse of z in the unit ciride be found and then 
reflected in the real axis; loi the first of these steps gives a eoni- 
plex number whoso length is \/\z\, and thc' second achieves the 
direction of z, as required bv (4) 

To show that circles are also transformed .nto circles in case 
c, let the substitution z = l/wi be made in the s('lf-conjugate form 
of the equation of a circle (2) This gives 

M 4 i) - -I + - + ^ +(/>+/■>>)- 0 

W W W V) 

or {D -f- f))iviv + Bw 4- Brv (A A) =0 

w'hich IS also the equation of a circle with real radius Tf A -|- A = 0, 
the original circle reduces to a straight line whose image is a circle 
passing through thc origin, since its equation contains no constant 
teirn Conversely, any circle passing through the ongin is trans¬ 
formed into a straight line 

The three special transformations we have just considered 
can be used to synthesize the general bilinear transformation To 
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see this, suppose first that c 5 ^ 0. Then the general transformation 
is equivalent to the following chain of special transformations- 

\Di - Z - 
C 

Wi = cw\ = cz -{■ d 

^ ^ 

W 2 cz + d 

he — ad he — ad 

Wa - - W3 = -7 - ~~r. 

c c(cz + a) 

, a be — ad , a az -\r b 

^ c c(cz -h rf) c cz 4- d 

On the other hand, if c = 0 , it is clear from the restriction 
ad — be ^ 0 that neither a nor d can be zero Hence, we can write 

, b 

Wi = z - 
a 

a a h\ az b 

"' = a“’' = aV" + 5j = -d- 

Thus we have shown that in all cases the general bilinear trans¬ 
formation can be compounded from a succession of simple trans¬ 
formations of types a, b, and c. Since each of these is known to 
transform circles into circles, including straight lines as special 
cases, we have thus established the following theorem 


THEOREM 1 

Under the general bilinear transformation circles are transformed into circles 


w 


The general bilinear transformation 

az -b b 
cz d 


depends on three essential constants, namely, the ratios of any 
three of the constants a, 6 , c, d to the fourth. Hence it is evideiil 
that three conditions are necessary to determine a bilinear trans¬ 
formation, In particular, the requirement that three distinct 
values of z, say zi, Z 2 , za, have specified distinct images ici, uh, 
leads to a unique transformation. 

Although the transformation which sends three given points 
into three specified image points can be found by imposing these 
conditions on the general equation and solving for the constants, 
it 18 generally simpler to make use of the fact that if w\, W 2 y wia. 
are, respectively, the images of Zi, Za, Z 3 , Z 4 , then 

(t/?l — W2)(W3 — Wj) ^ (Zi — Z2)(Z3 — Z4) 

(wi - tP4)(ws — Wa) ~ (zi — Z4)(Za — Za) 

To establish this relation, we observe that 

az, -b b __ azj + b ^ (ad — bc)(z, — Zj) 

cz* + d cz, -f d ~ (ezi -b d)(czj + d*' 


Wt — Wj 
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Hence 

~~ bc)(zi — Zz) (ad — bc)(z 3 — Zi) 
d)(cz 2 Vd) (_cX3 

(w^i - Wa)(w3 - lOj) (O Q? - bc)(zi - gV) (grf - bc)(z 3 ~ zQ 
(C2i -h rf)(r^4 -f rf) ((*23 -h ^i)(c^2 -h rf) 

= (- 1 ~ ^2)(g3 - 

(2i - zdizi — Zz) 

The last fraction is called the cross ratio or anharmonic ratio of 
the four numbers Zj, 22, 2a, Za] hence ihc result we have just estab¬ 
lished can be formulated as (he following theorem. 


THEOREM 2 

The cross ratio of four points is invariant under a bilinear transformation 

Suppose now that it is required to find the transformation 
which sends Zi, zz, Zi into wi, wz, Wi, respectively. If ic is the image 
of a general point z under this transformation, then, according to 
Theorem 2, the cross ratio of W], W2, w.], and w must equal the 
cross ratio of Zi, Zz, Z3, and z That is, 

( w \ — v))(wa - (21 — 2) (23 — 22) 

This equation is clearly bilinear in w and z and is satisfied by the 
three pairs of values ( 2 i,tC]), ( 22 , 1 ^ 2 ), (zt^^wa) Moreover, eviTything 
in it IS known except the variables w and 2 themselves; henee it is 
necessary only to .solve for w in terms of 2 to obtain the required 
transformation in standard form, 

EXAMPLE 1 

What IS the bilinear transformation which .sends the points z * -- 1, 0, I into the points u> *■ 0, 
h 3j, respectively'^ 

Setting up the appropriate (roh.s ratios, we have 

(0 - i)i3i - 7C) ^ (-] ~ 0)(l - z) 

((T^ 7^3? - 7 ) "" (-1 - Z)(l - 0) 

or _ 1 

2ie 1 + z 

Solving for w, we obtain without difficulty 

^ T 1 

w “ — 3x —-- 

z — 3 

EXAMPLE 2 

What IB the most general bilinear transformation which maps the upper half of the z-plane onto 
the interior of the unit circle in the le-plano (Fig. 17 5)? 

I.«et the required transformation be 
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z plane — ^ w plane 

FIGURE 17.5 
The upper half 
of the 2-plane to 
be mapped onto 
the interior of 
the unit circle in 
the uNplane 

Since the boundaries of correspondinR regions must correspond under any transformation, thp 
unit circle in the iw-plane must be the image of the real axis in the 2-plane Therefore, for all real 
values of 2, we must have 

I I _ 1°^ + ^1 _ N k + (fe/Q)l 
^ |c2 + d| lc| |2 + (d/c)| 

In particular, from the limiting case I2I —► «>, we find 




and thus for real values of 2, 


2 + 


2 + 


or 




The last equation expresses the fact that the complex numbers —6/a and — d/c are equally far 
from all points on the real axis, which is possible if and only if the real axis is the perpendicular 
Disector of the segment joining the points —6/0 and — d/c Therefore, — 6/tt and — d/c must be 
conjugates, say X and X Thus we can write 


02+6 
C2 + d 

a z + (6/a) 
c 2 + (d/c) 

a 2 — X 
c 2 — X 



where the last step follows because, as we found earlier, a/c is a complex number of absolute 
value 1 

So far we have enforced only the condition that the boundaries of the two regions correspond 
It is now necessary to make sure that the regions themselves correspond as required and that 1 he 
upper half of the 2-plane has not been mapped into the outside of the circle \w\ — 1 This is most 
easily verified by checking some convenient point, say 2 — X This maps into — 0 , which is 
certainly inside the circle jw;! — 1 Thus, if X is restricted to lie in the upper half of the 2-plane, 
the solution is complete 

As a special cose of some interest, let c** >» — 1 , and let X be a pure imaginary, say i Then 


( 7 ) 


w 


z — i 
2 + 1 


6{w) 


w — iB 


1 A - . I + A 

2l \2 + 2 I — l) 


Now 


2 i 
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or, reducing to a common denominator and simplifying, 




_g + s 

{z 4 - 7)(5 - t) 


The denominator of the last fraction le the product of z + i and its conjugate 2 - i and, hence, ir 
a positive quantity Thus, the imaginary part of w will be positive if and only if z 4 2 is positive 
Since z -\r z is equal to twice the real part of z, this shows that the transformation ( 7 ) not onl> 
maps the upper half of the z-plane onto the unit circle |wi| ^ 1 hut does it m such a way that the 
first quadrant of the z-planc [where (R(z) > 0] corresponds to the upper haii of the circle [where 
S(iv) > 0] and the second quadrant of the z-planc corresponds to the lower half of the circle 
in the opposite direction, the inverse transformation 


( 8 ) 


w — 1 
w 4 1 


jnaps the interior of the cin Ic j?/;] = 1 onto the upjar half of the z-planc in cuch a way that the 
upper half of the circle maps onto the first quadrant of the z-plane 


EXAMPLE 3 

Find a transformation w'hich will map an infinite sector of angle ir /4 onto the interior of the unit 
circle 

Since the boundary of the sector consists of portions of two straight lines, yet its image is to 
he a single circle, it is apparent that the mapping cannot be accomplished by a bihneai transfor- 
inalion alone However, a simph* combination of a pow(*i function and a linear fractional func¬ 
tion will define a suitable tran.sforination Specifically, the transformation 

t = z< 


will open out the sector m the z-planc into the upper half of the auxiliary f-plnne (Fi-r. 17 h) 


FIGURE 17 6 
The two trans¬ 
formations 
needed to map 
an infinite sector 
onto the interior 
of the unit cir( le 


z plane t plane ^ w plane 




Following this, the upper half of the 4plane ran be mapped onto the unit circle m the U'-plane by 
any transformation of the family (6), w^hirh we obtained in the last example, say 


w 


t - I 

f 4 t 


Combining these two, we have for the required transformation 


w 


z* — i 
1* -F i 


EXAMPLE 4 

Find a transformation which will map a 60° sector of the unit circle in the z-plane onto the upper 
^‘alf of the U’-plane 

At first glance it would seem that this problem can be solved simply by opening the given 
sector into a full circle by the transformation 


i - 
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2 plane *■ t plane 


FIGURE 17.7 



A circular sector 


“opened out" 



into a circular 

/ - Aa t f 

' \a' 

region cut along 
a radius 

0 r Ml' 

y 


and then mapping the circle from the t-plane onto the upper half of the u;-plane by meaiih of th,- 
inverse of one of the transformations of the family (6) which we obtained in Example 2. lor in¬ 
stance, the transformation (8) This method fails, however, because the circular region oblturu u 
in the f-piane in this case is not of the type considered m Example 2 The latter consisted of a sun 
pie circular boundary plus its interior, whereas the former consists of the interior of a circle “cut ’ 
along a radius, since the radius O'A’ » O'B' is actually the image of the two boundary ladii () 1 
and OB (Fig 17 7 ) 

To avoid this difficulty, let us first map the sector onto a semicircle by the transfonuatKin 
U - 2 » 

Then let us map the semicircle from the <i-plane onto the first quadrant of the ^rplane by nicn,- 
of the transformation (8) 


Finally (Fig. 17 8) let us open out the first quadrant of the /j-plane into the upper half of tlic 
t/;-plaiio by the transformation 


10 - 

Combining these three transformations, we find 



as the required solution 


2 plane ■ * plane -► ^2 plane 


u) plane 





FIGURE 17.8 


The sequence of transformations necessary to map a circular sector onto a half plane 


EXAMPLE 5 

A thin sheet of metal coincides with the first quadrant of the 2-plane The upper and lower facos 
of the sheet are perfectly insulated against the flow of heat Find the steady-state temperature 
at any point of the sheet if the boundary temperatures are those shown ir ^i'ig. 17 9a 
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(“) ( 6 ) 

FIGURE 17 9 

\n infinite 00 sector mapped, with ith boundary conditioiib, onto a half plane 

Under the assumptions of the problem, the flow of lieal in tlie sheet la two-dimensional, and 
\\{> must aecordinRly solve Laplace’s equation, i.e , tin two-dimensional steady-state heat equa¬ 
tion derived in Sec 8 2 , 

dx^ dy^ 

subject to the given conditions along the boundaries of the first quadrant To do this, it is con¬ 
venient to map the first quadrant of the ?-plane onto the upper half of the le-plane by the 
traubformation 

u' =« 2 ® = fj* — y^) -f- 2ixy 

This reduces the problem to that of finding a solution of Laplace’s equation in the upper half 
plane which assumes along the real axis the boundary conditions shown in Fig J 7 96 

Now we have long since discovered (Property 1 , Sec 14 6) that either the real or the 
imaginary part of any analytic function satisfies Laplace’s equation In particular, since the 
function 

(") iT, + - Ur, - r„) In (z - I.) + (T, - T,) In (z - j-,) + 

TT 

-b - Tn) In (z - rj] 

Is analytic except at the real points j-o, xi, , x„, its imaginary part, namely, 

(IIII 7 ' = To + - 1 ( 7 ', - To) arK (z - xo) + ( 7 ', - T.) arg {z - x,) + 

IT 

-b (r„+, - TJ arg (2 - xn)] 

"ill be a solution of Laplace’s equation Moreover, along the real axis, this solution takes on the 
boundary values shown in Fig 17 10 To see this, we observe from Fig, 17 10 that the complex 



OGURE 17.10 

Plot showing the behavior of arg (z — x.) as z vanes along the real axis 
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number 2 — x. is represented by the vector joining the fixed point x, to the variable point 2, and 
thus arg (2 — x.) is simply the inclination angle of this vector Hence the function (10) can be 
rewritten 

(11) T ^ T 0 [(Ti — 7’o)^0 “b (^2 — Tl)6i -b 4 - (Tn + \ — Tn)Bn] 

IT 

Again referring to Fig 17 10 , it is clear that, for all values of z on the real axis to the right of 
each of the is zero Hence from (11) we see that T reduces to the constant value T’o al(‘ng 
this portion of the real axis Furthermore, when z lies between ji and Xo, ffo is equal to n, but all 
the other 6's are still zero Henee, along this segment the temperature (10), or ( 11 ), reduces lo 

r = To + Kr, - ToM = r, 

IT 


Similarly, for values of 2 between it and Xi, the angles 0 o ami 0i are each equal to ir, but all other 
ff’s are zero Hence, along this segment, we have 

T = To + ‘ KT, - nv + (T, - T,M = 7\ 

IT 

Continuing in this fashion, we can verify that T, as defined by (10) or (11), not only is a solution 
of Laplace’s equation, being the imaginary part of the analytic function (0), but also assunic' 
along the real axis the temperature distiibutioii shown in Fig 17 JO 

Specializing these observations to our problem, it appears that the solution we require is 

T = 100 4 - - 1(0 - 100)^0 4 - (100 - 0 )»,) 

TT 

100 

= 100 4 -( 0 , - Ou) 

TT 

100 , 

= - - (it 4 - (fll — 0 o)] 

IT 

Now, multiplying by tt/IOO and then taking the tangent of both sides of the last equation, 
we have 


irT 

tan = tan [tt 4 - (^1 - ^0)] = tan (0i — do) 

tan di — tan $0 
1 -b tan 60 tan 0| 

Substituting for tan do and tan their values as read from Fig 17 06 , v\e obtain from the last 
expression 

^ ttT v/(u 4 " 1 ) — v/(y ■— 4 ) 

m ^ 1 ‘-b~eV(w +1) 4) 


u* 4- e* — — 4 

which IS the solution of the transformed problem in the te-planc Returning to the 2-]ilane b> 
means of the transformation equations 

u « X* — y* and V — 2iy 

wc thus find, from (12), that 


T 


100 -lOxy 

— tan~^---- 

r (I« 4- - 3i» 4- 3y* - 4 


IS the solution to the original problem 
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EXERCISES 

1 What 18 the cross ratio of the four fourth roots of — 1^ 

2 What IS the cross ratio of the four complex sixth roots of 1 ? 

3 Show that m general there are two points which are left invariant by a bilinear transforma¬ 
tion Are there any bilinear transformations which leave only one point invariant'^ no points 
invariant? 

4 Find the invariant points of th<* transfoimation w “ —(‘2z -f- 4i)!(iz -h I), and prove that 

these two points, together with any point z and its image w, form a set of four points having 

a constant cross ratio 

6 What IS the bilinear transformation which sends the poirits z = 0, —1, « into the points 
IV = — 1 , —2 — ?, 1 , respectively^ What is the image of the circle jzj * 1 under this 
transformation “i* 

6 What is the bilinear transformation which sends the points z = 0 , — 2i into the points 

w = 00 , —i/.‘h respectively^ What are the invariant points of this transformation'^ 

7 What IS the most general hilinenr tnin.'Nfonnntion v\hich maps the upper half of the z-plane 
onto the lo^^er half of the w-plane? 

8 Prove (hat w = ’/(I — maps the upper half of the z-plane into the upper half of the 
w»-plane What is the image of the circle jz] -- 1 under this transformation^ 

9 Find a transformation w hich will map an infinite sector of angle r/'S onto the interior of the 
unit circle 

10 Show tliat along tlie (ircle |f 2 4 d\ - '\/\ad — /h | the transformation ii.' = {az -\-b)/{cz 4-d) 
does not alter th(‘ lengths of inrinitesiinal segments What luippens to segments inside this 
circle? ( 'tside this circle'^ What is the* Im us of points where intinitesiinal segments are not 
rotated by the transformation'^ 

11 Find a transformation whicli will map a 4f)° seitoi of the unit circle in the z-plane onto the 
upjier lialf of the le-plane 

12 Find a transformation which will map the upper half of the unit circle onto the entire unit 
circle 

13 Show that, if jej = \d\, then the I ransfonuation w = (az h b)/i^rz -b d) maps the unit circle 
in the z-plaiie into a straight line in the a>-plane 

14 Verify that the transformation iv = rc‘“(z — Zi)/(z — Zj) maps the region in the z-plane 
houiuled hy twi» circular arcs intersei ting at an angle c* at zi and zi into the interior of an 
angle a in standard position m the jc-plane [Hint Rei all that an equation of the form ( 2 ) 
repri’sents a cin le in th(‘ z-plane ) 

16 Prove that four jioints Zi, Zi, ^4 he on a ciich* if and only if their cross ratio is real 

16 Find the steady-state temperature distribution m a sheet of metal coinciding with the first 
quadrant of the z-plane if T = 100"' along the positive x-axis and T = 0 "' along the positive 
i^-axia 

17 Find the steady-state tenipernture distribution in a sheet of metal coinciding w ith the interior 
of a 00 ° angle in standard position in the z-plane if T == 0° along the horizontal side of 
the angle and T = 100° along the other side 

18 Find the steady-state temperature distribution in a sheet of metal coinciding wutli the first 
quadrant of the z-plane if T = 100° along the positive y-axis, if T = 50° between 0 and 3 on 
the i-axis, and if T’ = 0 to the right of 3 on the z-axis 

16 Find the steady-state temperature distribution in the unit circle in the z-plane if the upper 
half of the boundary of the circle is kept at the temperature T = 100° and the lower half of 
the boundary is kept at the temperature F =» 0 ° 

20 Show’ that w = z \/z maps the portion of the upper half of the z-plane exterior to the 
circle |z| = 1 onto the entire upper half of the le-plane Use this result to find the steady- 
state temperature distribution in the upper half of the z-plane exterior to the unit circle if 
T = 100° along the linear portion of the boundary and T = 0 ° along the circular portion of 
the boundary. 
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The Schwarz-Christoffel transformation 

In general, the conformal transformation of one given region into 
another is exceedingly difficult The existence of such a transforma¬ 
tion IS assured by the following theorem, due to Riemann. 


THEOREM 1 

Any two bounded simply connected regions can be mapped conformally onto each 
other. 

However, the determination of the specific function which ac¬ 
complishes a required mapping is usually out of the question. In 
fact, in addition to the simple regions which we found could be 
mapped by means of the elementary functions, the only class of 
regions for which conformal transformations of practical interest 
exist are those bounded by polygons having a finite number of 
vertices (one or more of which may lie at infinity). These can 
always be mapped onto a half plane and, hence, onto any regioF» 
into which a half plane can be transformed, by means of a trans¬ 
formation which we shall now discuss 

To see how this can be done, we first recall the mapping 
properties of the power function 

w = 

Since this transformation has the property (Theorem 3 , Sec. 17 2) 
that it alters by the factor m any angle with vertex at the origin, 
it follows that the transformation 

( 1 ) w — Wi = (z — 

will take a segment of the x-axis containing Xi in its interior, i c , 
a straight angle with vertex at X], and “fold^' it into an angle of 

CX^ 

— T = ai 
IT 

with vertex at wi. Clearly, if this could be done simultaneously 
for a number of points Xi, X2, . . . , on the x-axis, the x-axis 
would be mapped into a polygon whose angles were, respectively, 
tti, a2, . . , an and conversely, and the biggest step in the solu¬ 

tion of our problem would be taken This is actually possible, and 
the transformation which accomplishes it, suggested by the form 
of the derivative of (1), is defined by 

(2) K{z- X,)<••''>-*(* - • • (* - 

To verify this, we begin with a point z on the x-axis to the left 
of the first of the given points xi, X2, . . . , and investigate the 
locus of its image as it moves to the right along the x-axis (Fig- 
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z plane plane 




FIGURE 17.11 

The mapping of the real axis in the z-plane into a polygon with prescribed angles in the w-plane. 

17.11) From (2) we obtain at once the relation 
(3) arg dw = arg K -f — 1^ arg {z — X\) 

+ arg (z - Xi) + 

+ arg (z - T„) + arg dz 

and in this it is apparent that until z reaches Xi, every term on the 
right remains constant, since z — xx, z — Xi, . . . , 2 — x„ are all 
negative real numbers and, hence, have tt for their respective 
arguments, and since dz is positive and, therefore, has 0 as its 
argument Thus the image point w traces a straight line, since the 
argument of the increment dw remains constant However, as z 
passes through Xi, the difference z — Xx changes abruptly from 
negative to positive, and thus arg (2 — Xi) decreases abruptly 
from IT to 0 Hence, arg dw changes by the amount 

(v “ 0 

But, from Fig 17.116, it is evident that this is the precise amount 
through which it is necessary to turn if w is to begin to move in the 
direction of the next side of the polygon. As 2 moves from Xi to Xa, 
the same situation exists The argument of dw remains constant, 
and thus w moves m a straight line until z reaches X 2 . Here 2 — Xa 
changes abruptly from negative to positive, arg (2 — Xa) jumps 
from TT to 0, and, as a consequence, arg dw increases by the amount 
TT — aa, which is the exact amount of rotation required to give the 
direction of the next side of the polygon. 

Thus as 2 traverses the x-axis, it is clear that w moves along 
the boundary of a polygon whose interior angles are precisely the 
given angles ai, aa, . ■ • , an- Moreover, it is evident that the 
region which is mapped onto the half plane is the region which 
contains these angles. The required transformation will be ob- 
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tained if we can ensure that the lengths of the sides of the polygon, 
as well as its angles, have the correct values 

Now the mapping function w, obtained by integrating (2), is 

(4) W — Kfl(z — ' (z — dz -h C 

and this can be thought of as the result of the two transformations 

(5) / = f[(z - • ■ (z - dz 

(6) w = Kt-h C 

The first of these transforms the x-axis into some polygon which 
the second then translates, rotates, and either stretches or shrinks, 
as the case may be If, then, the polygon determined by IS 
similar to the given polygon, the constants in (6) can always lie 
determined so as to make the two polygons coincide 

Now for two polygons to be similar, not only must cor¬ 
responding angles be equal but corresponding sides must be pro¬ 
portional For triangles this is automatically the case. For quadri¬ 
laterals one further condition is required, namely, that two pairs 
of corresponding sides have Ihe same ratio For pentagons two 
such conditions are required, and, in general, for a polygon of 
n sides, n — 3 conditions, over and above the equality of cor¬ 
responding angles, are necessary for similarity. Hence, in map¬ 
ping a polygon of n sides onto a half plane, three of the image 
points xi, X 2 , . , Xn can be assigned arbitrarily, following 

which the remaining n — 3 are determined by the conditions ot 
similarity In many important problems, a vertex of the polygon, 
usually an infinite one, will correspond to 2 = ■» In this case 
dw/dz contains one less term than usual and, hence, one less 
parameter Therefore, only two of the — 1 finite image poinis 
-Ti, 3 : 2 , . . , Xn-i can be specified arbitrarily. In either case the 

resulting transformation is known as the Schwarz-Christoffel 
transformation. Obviously, since w is analytic evelywhere, 
except possibly at the points xi, X 2 , , Jn, the transformation 

IS conformal In practice, the usefulness of the Schwarz-C’hri^toffcl 
transformation is often limited by the complexity of the integriLl 
which defines the mapping function w. 


EXAMPLE 1 

Find the transformation which maps the senn-infinite strip shown in Fig 17 12a onto the half 
plane, as indicated 

The required transformation is defined by 


dw 

dz 


’r/2_i ^/2 

K{z d- 1) (? - 1) ^ 


_1 1 
K{Z + 1) 2(2 _ 1) 2 


Hence, 


r dz 

W ^ K I = K coflh”^ z + C 

J V 2“ - 1 


* Named for the German mathematicians H A Schwarz 1843-1921) ftoft 
E. B Christoffel (1829-1900), who discovered it independi itly about 186.> 
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w plane 


z plane 


figure 17.12 

A eemi-infinite 
strip to be 
mapped onto a 
half plane 




fb) 


Since w *“ 0 le to correspond to z = I, we have 

0 s» A' co8h~* 1 -b r or » 0 

Also, w =» iir le to correspond to z * —1, and thus 

irr — K cosh"^ ( — 1) — K(tir) OT K 
The required transformation is, therefore, w — cosh" * z, or 
z “ cosh u) 

Broken down into real and imaginary parts, this becomes 
X ty me cosh u COB f; -f I smh v sin v 
or X "= cosh u cos r' 

y « smh u sm v 

Eliminating u and r in turn, we have also 


V* 


cosh* 7/ smh* v 

X* 7/* 


1 


COS* r am* i; 

Hhif’h, if necessary, can be solved for u and v in terms of x and y 

EXAMPLE 2 

1 ind the transformation which maps the infinite region shown in fig 17 J!la onto the upper half 
plane as inditnted 

W ith images assigned as shown and w ith the angle at the finite vertex A identified as ai ^ 2ir 
and the angle at the infinite vertex B identified as ai = 0, we liave 


dz 




figure 17.13 
A semi-infinite 
cliannel to be 
mapped onto a 
half plane 



A' 


(a) 


z plane 

(b) 
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and 

(7) w K{z +\nz) -\-C 

To determine the constants K and C, we write (7) in the form 

w -}- IV * (Ki -h iKi){x -f- ly + In \z\ -h i arg z) Ci iCj 
from which, by equating imaginar^'^ parts, we obtain 

(8) V - Kiy -f KiX + Ki In \z\ + Ki arg r 4- Cj 

Now, when w becomes infinite along AB, on which v * ir, the image point z approaches zero along 
the negative real axis, on which y *■ 0 and arg z “ t. Hence, from (8), 

T * lim (Ki • 0 -|“ Kjt -|- Aj In |z| K\ir -b C?) 

»-*o- 

Obviously Ki must be zero to keep In jzj from making the right member infinite. Hence, 

(9) T ■* A’jir + Ci 

Also, as w becomes infinite along OB, on which v “ 0, the image point z approaches zero along 
the positive real axis, on which y “ 0 and arg z •- 0 Hence, using (8) again, we have 

0 - hm (A'l 0 + r,) - (\ 

*-40+ 

Therefore, Cj “ 0, and so from (9) we find that Ai » 1, Thus (7) reduces to 
ic “ z 4- In z d- Ti 

Finally, the point ic “ or must map into the point z * —1 Hence, from the last equation, 

IT *■ —1 -H In ( —1) -b Cl 
— 1 4- It 4“ Cl 

and so Ci must equal 1 The required mapping function is, therefore, 
tr — 2-blnz + l 

Figure 17 14 shows the curves m the ic-plane which correspond to the lines i — 0, 
the lines y =» t/4, t/2, 3t/ 4 The resulting configuration can be shown to represent either the 
lines of equal velocity potential and the streamlines for the flow of an ideal incompressible 
fluid from an infinite straight channel or the lines of flux and the equipotcntial lines for a 
parallel-plate condenser 


3t 
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EXERCISES 

1 Find the transformation which will map the region shown in Fig IT.irwi onto the upper half 
plane, as indicated 



w 

y 

FIGURE 17.15 ^ 

'^-2*' -1 

1 

A ( 

0 ) » B 

0' A' ^ 

(-1) v_ 




(a) (6) 


2 Using the results of Exercise 1, find the steady-state temperature distribution m the ui-plane 
if the upper side of the negative a-axis is kept at the temperature T =• 100“ and the lower 
side of the negative a-axis is kept at the temperature T = 0“ 

3 Find the transformation which will map the exterior of the first quadrant in the le-plane 
into the upper half of the z-plane, as indicated in Fig 17.16 
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FIGURE 17.16 



1 




0 

B 

L* 


(a) 






-1 


1 


B' 

0 ' 

A' 

X 


ib) 


4 Using the results of Exercise 3, find the equations of the isothermal curves m the exterior of 
the first quadrant of the ic-plane if the positive w-axis is kept at the temperature T = 100“ 
and the positive half of the t-a\is is kept at the temperature T* “ 0“ 

5 Find the transformation which will map the region shown in Fig. 17.17a onto the upper half 
plane, as indicated. 


figure 17.17 
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6 Using the results of Exercise 5, find the steady-state temperature distribution in the upper 
half of the w>plane if the w-axis is kept at the temperature T - 0“ and the .segment of the 
t-axis between 0 and t is kept at the temperature T " 100“ 
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7 By first mapping into the z-plane as indicated, find the steady-state temperature at any 
point in the region shown in Fig 17 18 


FIGURE 17.18 
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(a) (b) 

Find the transformation which will map the region shown in Fig 17 19a onto the upper 
half plane, as indicated 


FIGURE 17 19 




(a) 


(b) 


9 f'md the transfoiination which will map the region shown in Fig 17 20a onto the upper 
half plane, as indicated 


FIGURE 17 20 



(a) 


(b) 


10 Find the transformation which will map the interior of the infinite strip 

0 ^ ^(w) S TT 


onto the upper half of Ihe 2 -plane (Hint Consider the strip as the limiting form of 
quadrilateral shown in Fig 17 21, as ici and wia become infinite, and let mm, w^, and w-, corrr 
spond, respectively, to 2 0, 1, and with the image of to be determined ) 


FIGURE 17.21 
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Appendix 


A.1 

GraefFe’s root-squaring process 

At various points in our work, notably in the solution of systems 
of simultaneous differential equations and the determination of 
the inverse Laplace transforms of rational fractional functions 
of ,s', w(‘ found U necessary to solve polynomial equations of rela¬ 
tively liigh dc'pree Since exact formulas tor the roots of a poly¬ 
nomial equation 7 \(j') = 0 exist only when n ^ 4 and since, when 
11 = 8 and n = 4, these are complicalcd and awk\vard to use, it 
IS clear that (he roots of y\(j) = 0 will usually have to be found 
by some process of numerical approximation Xunierous pro¬ 
cedures are available for this purpose, including Mewton*s method 
and the method of interpolation However, in many res])ecls (he 
best method is what is known asGraeffe’s root-squaring process,* 
w'hich has the desirable feature tliat it yields all the roots, both 
real and complex, at essentiallv (lie same time To presonl the 
theorv of this method, let us assume first that the roots of the 
given equation 

(1) j-" -f -h -h -h = 0 

say — ri, — r 2 , — r^, . , ~^ri, are all real and distinct and hiwe 

been arranged in decreasing order of absolute value from —r^ to 

Now let us rewrite Eq. (1) with all even powers of j* on one 
side and all odd powers of x on the other 

-h a2X”"2 -j- 4 -{- = ^ ) 

and then square both sides 


* Named for the Swiss mathematirian C H Graeffe (1799-1873), who pub¬ 
lished this method m 1837 in a paper which won a prize ofTered by the 
Academy of Sciences of Berlin for a practical method of computing complex 
roots. 
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X*" -j- -h -f 

H-2a2X*"^* + 2fl4a:^"“* -f ‘ ‘ • 4-2aia3X*'' “* 4- 2aia6x’^”~® + 

-l-2a2a4X*""* -}- ■ ‘ -f 20805x2””’’ 4- • 

-f-.. +••• 

Collecting terms again on the left, we obtain 

(2) x*" — (oi^ — 2a2)x2"”2 -f (o2^ — 20103 -|- 2o4)x2”~'‘ 

— (o8* — 20204 -f 2oiOfi — 2a6)x2” “® 4- • 0 

Since Eq ( 2 ) was obtained from ( 1 ) by squaring, it is cvidenl 
that it will vanish for any value of x for which Eq. (1) vanishes 
In other words, any root of the original equation is also a root 
of the derived equation (2) Now, in (2) let y ~ Then 

= {-yV = (~ 1 )" 2 /" 

^ 2 n -2 _ ^ yn -1 

and dividing out ( —1)'^, Eq ( 2 ) becomes 

(3) V” 4" (oi* ~ 202 ) 1 /”'* 4“ (02^ - 20103 + 2o4)y""* 

d- ( 03 * — 202 O 4 + 20106 - 2 ae) 2 /”’ * 4- ' ^0 

By virtue of the substitution y — —x^, it is evident that the 
roots of (3) are — ( —ri)*, — ( —r 2 ) 2 , . . , — ( —r„) 2 . or —u\ 

-r2\ , We have thus constructed a now equation 

whose roots are numerically equal to the squares of the roots 
of the original equation Obviously, by repeating this process, 
equations can be obtained whose roots are numerically equal to 
the fourth, eighth, sixteenth, thirty-second, . powers of the 
roots of Eq. ( 1 ). 

The effect of this root-squaring process is to give equations 
whose roots are more and more widely separated For instance, 
if two roots of the given equation are m the ratio 5 4, then their 
128th powers are in the ratio 
5128.4128 or 2 54 X 10*M 

This is a highly desirable situation, for, a.s we shall soon see, 
equations whose roots are widely separated can readily be solved 
with considerable accuracy 

The squaring process which leads to equations whose loots 
are high powders of the roots of a given equation may he carried 
out systematically in tabular form as follow's Write down the 
successive coefficients in the original equation, taking care to 
write zero for the coefficient of any missing term. Then under 
each coefficient write its square and twice all products of coeffi¬ 
cients symmetrically located on each side of it, the signs of the.^e 
products being alternately negative and positive a« coefficient^' 
farther and farther from the one in question are multiplied. The 
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sum of the terms placed below any coefficient in this array is 
the coefficient of the corresponding term in the new equation. 

Now suppose that by a number of repetitions of this process 
an equation 

(4) -h -h • • + a,_iZ -f a. = 0 

has been obtained whose roots are numerically the mth powers 
of those of the given equation, or specifically —ri", — ra*", — rs"*, 

• . . , — rn*" From the usual relations between the roots and the 
coefficients of a polynomial equation, it follows that 

ai = — (sum of the roots) = -f- -f ra"* + -h rn"* 

aa = sum of the roots taken two at a time 

= ri-V,- + -h + 

( 5 ) , = — (sum of the roots taken three at a time) 

= + ri*V2’"r4'" -f * ' ’ -f- + -f r,;^2C_irn"* 

= ( —1)"(product of all the roots) = ■ Tn*" 

Under the hypothesis that |ri| > jrzl > \ri\ > ■ > |rn! 

and that m is large, say 128 or 256 , it follows that ri" is enor¬ 
mously larger than r2^, which in turn is enormously larger than 
ra"*, and so on Hence, to a high degree of approximation, 

ai ~ ri"* 
aj = ri’^2”' 
as = 

an-i = ri"V2"V3"‘ • • r^-i 

otn = ri"r2'^'3" ’ 

since in each case the first term is very much larger than any 
or all of the succeeding terms. 

Thus, |ril can be found simply by extracting the mth root 
of the second coefficient in the final equation ( 4 ). Similarly, since 
the ratio of the third coefficient to the second is 

ai ri" 

|rj| can be found by extracting the wth root of this ratio In the 
same way, |ra| is the mth root of the ratio of the fourth coefficient 
to the third, and so on. The signs of the roots cannot be deter¬ 
mined by this procedure, but can easily be inferred from a rough 
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sketch of the graph of the left member of the original equation 
(1) supplemented by Descartes’s rule of signs. Example 1 will 
make the details clear. 

Just how many root-squaring operations must be performed 
in a given case, i.e., just how large m should be, cannot be told 
in advance. An adequate working rule is to continue until each 
new coefficient (with certain exceptions in the case of multiple 
roots and complex roots) is essentially the square of the preceding 
one, i.e , until the product terms in the calculation of the new 
coefficients make no appreciable contribution. 

The case of equal roots can be handled without difficulty 
by returning to Eq. ( 4 ) and supposing two of the r's to be equal, 
say rj = Then when all but the dominant terms in each 
coefficient are rejected, we find from ( 5 ) that 

ai = ri" 
at = 

as = ri"V2'”r3*" ~ 

0(4 = ri’"r2"*r3*"r4”* = 


otfi-i = ri"V‘2*"^'a"*r4"*r5"* = ri"*r2”T3*'”r5’" * • ■ 

ocn — ri”'r2"‘r3"V4"*r6“ r"_irn" = ri”*r2*r8*’"r6’" ■ ‘ 

Hence, to a high degree of approximation, the final equation is 
z* -h -h -f -h -f - 0 

Evidently, for each pair of equal roots there will be one term 
(the fourth in this case) which, as the root-squaring process is 
repeated, does not approach the square of its previous value but 
instead approaches one-half this value. In other words, when 
two equal roots are present, there is always one coefficient for 
which in the root-squaring procedure the product of adjacent 
coefficients never becomes negligible but always makes a con¬ 
tribution approaching one-half the square of the coefficient itself 





-1 

2ri’"ra"*r3’" 







- 2(ri’"r2"') 





! 







When one or more coefficients behave in this manner as successive 
equations are constructed, the presence of double roots is always 
indicated, and the process can be terminated as soon as all but 
the exceptional coefficient or coefficients are uninfluenced by the 
product terms. 

The determination of the roots in this case, once it is recog' 
nized, is simple enough All roots except the re^*eated one can 
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be found just as before by extracting the with root of the ratios 
of successive pairs of noiicxceptional coefficients. The repeated 
root can he found by extracting the 2 w 7 th root of the ratio of the 
coefficients immediately following and immediately preceding 
the exceptional coefficient. Here again, the signs of the roots 
must be determined by subsequent inspection. 

When the given equation contains a pair of complex roots, 
necessarily conjugate.s of each other, the analysis is a little differ- 
en(. To investigate this case, suppose specifically that the equa¬ 
tion to be solved is of the fourth degree with roots — ri, 

—/ nc —7 3 , whose absolute values are such that |ri| > |r 2 | > 
Ir^l The e(|aation can then be written 

(x -h ri)(x -f r 2 €'^)(x -h r^e ^^)(x r^) = 0 

After vf root-s(iuaring operations have been performed, the 
resultant equation has roots 

and can, therefore, he written 

(z -h ri"')(2 -h -I- = 0 

or 

(6) 4- (? r -h 4- 4 rz”^)z^ 


-f 

(n 







4 r2^e'^^r7r -h r2”"e' 


-h 

(n 








4 

(r 

^me — Q 




whore the coefficients have been expressed at length as the 
appropriate symmetric functions of the roots 

In every coefficient in ( 6 ) except the coefficient of 2 ^, the 
first term is obviously the term of greatest absolute value This 
is not the case in the coefhcient of 2 ^, however, for by combining 
terms this can be written 

2 ri"‘r 2 "* cos niB 4 * + 72^"* -f 2 r 2 ”*r 3 ’" cos md 

and it IS clear that, if cos ni6 is approximately 1 or — 1 , the first 
term is dominant, whereas, if cos md is approximately 0 , one 
of the later terms is dominant Thus, as m increases, the coefficient 
of 2 ^ continuou.sly fluctuates in sign and does not become and 
remain positive, as it does when all the roots are real. This is the 
characleristic which identifies the presence of complex roots in 
polynomial eipiations of all degrees, as many coefficients behav¬ 
ing in (his manner as there are pairs of complex roots. 

Once the existence of complex roots is recognized, it is a 
simple matter to obtain the absolute values of the real roots by 
extracting the with root of the ratios of successive nonexceptional 
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coefficients, just as before. Moreover, the modulus of the complex 
roots can be found by taking the 2mth root of the quotient of 
the coefficient which immediately follows the exceptional one 
divided by the coefficient which immediately precedes the 
exceptional one. 

To complete the determination of the complex roots, for 
which at this stage only the absolute value is known, let those 
roots now be written in the form u ± iv. In the original equation, 
the coefficient of x""' is the negative of the sum of the roots; 
hence, 

Oi = —[ —ri + (u + iv) + (w - iv) - ra - • •] 

j .1 —ai — ( —Ti — fa — ■ ) 

— — M(coefficient of + sum of all real roots) 


As soon as u is determined, v can be found from the familiar 
identity = u* r* 

As we have already remarked, the presence of more than 
one pair of complex roots is indicated by the presence of more 
than one coefficient which fluctuates in sign as the root squaring 
continues. In this case all real roots can be found, just as before, 
from adjacent pairs of nonexceptional coefficients by extracting 
the mth root of their quotients. The moduli of the various com¬ 
plex roots can also be found, as before, by taking the 2mth root 
of the ratios of the coefficients immediately after and imme¬ 
diately before each exceptional one, the exceptional coefficients 
being necessarily nonadjaceiit if the pairs of complex roots arc 
of different absolute value The only modification required in 
this case is in the determination of the real parts of the various 
complex roots. 

To illustrate this modification, let the given equation con¬ 
tain two pairs of complex rootrS 

u\ ± W\ and u% ± 

of absolute values ri and rj, together with additional real roots 
— ra, — r 4 , . . . . As before, the coefficient of in the original 
equation is the negative of the sum of the roots; hence. 


Oi — “[(ui -h Wi) H- (wi — ivi) -|- ('^2 + ^ 2 ) + {ui — ivi) 

- rg — r4 - • • ] 


== —2ui — 2ui + Ti “b 74 -H ■ 

or 


Ui -h Ui 


-ai — ( — rg — 74 - • • 
2 


= — H(coefficient of -H sum of all real roots) 

This is one equation in the unknown real components Wi and wi- 
To obtain a second equation in ui and ua, wt make use of 
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the fact that the coefficient of x in the original equation is equal to 
(sum of the roots taken n - 1 at a time) 

Hence, 

— Wi)(w2 -h tVi){u2 — — • 

-f (ill -I- M;i)(n2 + iV2){u2 — W2)(-r3)( —rO 
H- (ui -h tVi){ui — Wi){u2 — W2){~r3)i — rA) 

4- (ui -h tVOCwi — iVi)(n2 -h ^^2)( —r3)( —r^) • • ■ 

-h (ui -h Wi)(ui — M;i)(n 2 H- Wi){u 2 — iVi) (sum of 
all products of the n — 4 real roots taken n — 5 

at a time)] 

= ( —l)"'4(wi -- tvi)r 2 ^ (product of the n - 4 real roots) 

-f (wi 4- Tri)r 2 ^ (product of the n — 4 real roots) 

-|- (u 2 — tV 2 )ri^ (product of the n — 4 real roots) 

4- (vi 4- W 2 )ri^ (product of the n — 4 real roots) 

-h riV 2 * (sum of all products of the n — 4 real roots 

taken n — 5 at a time)] 

~ ( —l)"“H( 2 uir 2 * 4“ 2 u 2 ri^) (product of the n — 4 real 

roots) 

4" rih 2 ^ (sum of all products of the 71 — 4 real roots 

taken n — 5 at a time)] 


Hence, finally, 


Wirj* -I- 
or 


(_l)n-i^^ 1 _ Trih 2 ^ (sum of all products of the 
n — 4 real roots taken n ~ 5 at a time) 
2 (product of all 71 — 4 real roots) 


Uir2^ -h UiVi^ 


_(-l) "-^an-i _ 

2 (product of all 71 — 4 real roots) 

T 1^7*2^ 

(sum of reciprocals of all ti — 4 real roots) 


From Eqs (7) and ( 8 ), Ui and U 2 can be found at once. Then 
and 112 can be determined from the relations 

= Ui^ -h vi^ and r 2 * = W 2 * -f 

When more than two pairs of complex roots arc present, this 
procedure can be generalized by using, in addition to the relation 

= — (sum of all the roots) 

and the .r-coefficient relation, other relations arising from the 
coefficients of x^, x\ , However, these further equations in 

the real components Ui, uj, ua, W 4 , . . . are nonlinear, and 
solving them for Wi, u*, Ut, w*, . . may be very difficult. 
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EXAMPLE 1 

Find all the roots of the equation 

PiCx) » + I* — 4j:‘ — 4x* — 2x‘ — 6x* — j — 1 — 0 

The construction of the successive equations presents no difficulty and is adequately set 
forth in Table A.l By the time m — 128, all coefficients are uninfluenced by the product terms 
except the fifth and the seventh, which continually fluctuate in sign We can, therefore, terminate 
the root-squanng process at this stage with the assurance that there are two pairs of complex 
roots and three distinct real roots 

To find the magnitudes of the three real roots, we have 

log (7.4844 X 10«) 


log 

l*-ll 


kil 

log 

Ir.l 


|r,| 

log 

kil 


k.| 


128 


' 0 33496 


log (4 1006 X 10^») - log (7 4844 X 10^') 
128 


- 0 28702 


lo g (7 2835 X 10^00) - log (4 10 06 X 10^“) 
128 


0 16601 


Since there is only one change of sign between successive coefficients in the original equation, 
only one of the three real roots can be positive Since 1 *7(2) “ - 39 and Jp7(3) — 1,617, the posi¬ 
tive root must he between 2 and 3 Hence, the real roots are approximately 2 162, — 1 936, 
-1 466 

To find the absolute values of the complex roots, we extract the 256th root of the ratio‘s of 
the coefficients just after and just before the exceptional coefficients Thus 

log (4.1083 X 10^») - log (7 2835 X 10f>») 


log n 

r4 - 0 8264 


256 


9 91700 - 10 


log r# - 

r* - 0.4887 


log (1) - log (4 1083 X 10^») 

— - ^-- - 9.68901 - 10 


256 


The real parts of these roots must satisfy Eqs (7) and (8), hence 

-1 - [(2 162) + (-1 936) + (-1.466)1 


and 


Ui -I- Ut 
1/4 -)- T/j * 0.120 

?/«(0 4887)* + (0.8264)* 


(-1)‘(-1) 


2(2 162)(-1 936)(~1 466) 
(0.8264)»(0 4887)* 


(2 162 


+ - 


1 


2 \2 162 -1 936 

or 0 239t/4 + 0 683 w6 - -0 021 

Solving these two equations simultaneously, we find without difficulty that 
1/4 " 0.233 and us * —0 113 
Hence, va • y/ ri* - 114 * - 0.795 

t)| — \/rj* — lift* ■■ 0 476 

The complex roots of the given equation are therefore approximately 
0.233 ± 0.796i and -0.113 ± 0.476i 


-1 460 y 
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EXEECISES 

Find all the roots of each of the following equations 

1 I* - 6i* -{- llx - 7 - 0 2 4- 21* + 21 -f 2 - 0 

8 X* - I* - lOx* - a: -f- 1 - 0 4 4z‘ -h 16i* + 25z* -f 21z + 9 - 0 

6 16z“ - 16z* - 12x* -h 12i* - 1 - 0 6 z» - 5z* + 4x - 10 - 0 

7 z* - 8z* -h 17z» - lOz* + 10-0 

8 DiacuflS the application of the root-squaring process to an equation with a triple root. 

9 Discuss the application of the root-squaring process to an equation with two pairs of com¬ 

plex roots of equal moduli 

10 Discuss the application of the root-squaring process to an equation with a pair of complex 
roots and a real root whose absolute value is equal to the modulus of the complex roots 



Answers to 

Odd-numbered 

Exercises 


Chapfer 1 




sac. 1.2 

1 

Second-order, ordinary, nonlinear 

P 7 

3 

Second-order, ordinary, nonlinear 


6 

Second-order, ordinary, linear 

7 Second-order, partial, linear 


19 

- 2y" - y' + 2i/ = 0 

21 x‘y" - 2xy' E 2y = 0 


23 

y" - 4y = 0 

26 2yy" — (y')* » 0 

sac. 1.3 

1 

V " 

8 y - In |y -E 1| - X* - 

P 11 

6 

y “ (2 - cx)/{l - cx) 

7 y* — ce~*/x 


e 

<’*'( J/ ■“ 1 ) “E <’’*** c 

11 y - 2i» -E 2 


18 

^ / -2x» -E 1 

No Yes, V = ^ 

^ 1 x> -E 1 

o o 

V Ail 

H h 


19 

X -E e" =» c 


sac. 1.4 

1 

When the coefficient of dx is simpler than the coefficient of dy 

p 14 

8 

y - z + 

6 y* ■* cx* — X* 


7 

1 /' = i’{8 — In |i|) 

9 (y - 2x)«(y -E x) - 27 


11 

y' - X’ - H (7 V5 1 »») 

.. , /•'> i«®i - A . 

«'-[ InW 


17 

(V - 3)> + 2(r + 2)(v - 3) - 

(x -f 2)> - c 


19 

\/x* -E y* 


sac. 1.5 

1 

jl _ yl _ 3j«y ai c 

8 }ix* -E Hy* -E x*y - c 

p 18 

6 

2cy - 2x -E x*y -f 4y In |y| 

7 In |cxy| - - 1/xy 


9 

I*y* - (x/y) -E c 



11 

j* _ -j- 2jy “ c The equation is both homogeneous and exact 


18 

x*y* — I* — y* * c The equation is both separable and exact 

sac. 1.6 

1 

- -E The equation is also exact. 

p 21 


^ ^ ^ 

/ A 

/ T*\ 


8 


6 v-(l-x)(c--) 


7 

2 sin* X 1 

^ 3 3 sin X 
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S«C. 1.7 

p 25 


y " + cx~^^ The equation is also homogeneous 

T M 4- rn~^ 


11 X - jtiy* -1- cv"* 
13 y - x + \/r+~: 
17 y~* » X* -H cx 


19 y^ - 


2x» 

+ ce' 


X < 0 
1^0 


8 4 27 per cent, 2 91 per cent 
7 Q - 30 - 1500/(( -h 50) 


Ip- 14.7g-oooooiiM 
6 2.4 times 
9 242 days 

11 w — The flywheel will never come to rest* 

18 V - (w/k)(l - c-*®'/-), s - {w/k)[t - {w/kg){\ - 


16 v - ./— -/i - - i - - ( 

\m \y Vo \myo 2 


2y - yo 


?/o 


+ V 


VoV 


17 y — — Xo sin \/fc/m < x = Xo cos \//r/w < 

19 Q - 2(100 - t) - 150[(100 - O/lOOl* 0 ^ i ^ 100 
21 g - 20 - 060/(/ + 48) 23 7’ - 20 -f 80e-“ 

26 Q — (To — Ti)k/h, where k is the thermal eonciuctivity of the material 
of the wall, T ^ To — (To — T\)x/h 
AkvToTiiTo - Ti) 


27 Q 


ri — To 

rial of the sphere, T 


where k is the thermal conductivity of the mate- 
TiTt — rgTo rori(T| — To) 1 


29 

81 

38 

86 


ri — To 

i “ {E/R){\ - 0 693L//1? 

E. 


y 3s 

3r’A y/g 
R' 

r« y/Tg 


(R cos <at L sin lot — Re' 5 - tan"* 


ioL 


/?* 


(2h)^^ - (2yV^ - -f (2y - y ^ ■ 

(t - hn) - y/2h ~ 2\/y V < \ 


where ikn is the time it takes the tank to dram to ii depth of h/2 The time 
for the tank to dram completely is 


87 

89 


R2 -h 

1 1 




■n/2(? 

_ - wt 

\/ y \/ h 3irr® 

X* - — ]/• In |cy| 


The tank will never be completely empty' 


Chapter 2 

sec. 2.1 

p 35 


1 a j/ — Cl sin I -h ca cos x 
c j/ — cic* + caxe”* 

6 1/ " cii 4- csx~‘ 


b p — ciP"* + r2e" •* 
d p — ci(x — 1) -I- ca( —X* -f~ X - 1) 
f y — cix 4“ Cjxe* 


sec. 2.2 

p. 41 


1 Dy 18 a function, namely, the derivative of y, whereas yD is merely an 
operator 

8 (D4-x)(D + 2x) -(2x*4-3x-f 3)c* (/) 4-2x)(7; 4-x) - (2x* 4-3x 4-2)c' 

These expressions differ because, in permuting the o^icrational cocfh- 
oients, variable terms are moved across symbols of dit<^ 4 :reotiation 
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sec. 2.3 

p 49 


sec. 2.4 

p r>] 


sec. 2.5 

p 55 


sec. 2.6 

p 62 


6 1/ “ 4- cae'^* 7 y = 

® .V *= Cic -^'2 11 y =, .1 ros - + /^ain ~ 

\ 10 10 

IS 5y - 66-“' + I4e^ 16 4y = e** + 3e-'* 

17 1/ = 

19 There la no solution satisfying the given conditionR “xeept y ^ i) 

26 Yes 


I V = r,e~‘ -f fa^'' + (3 j - 7)/9 

8 1/ = Cl + fae ^ + j + xV2 

6 1 / » f--{4 cos 3 j 4- B sin 3x) -f- (75 j^ - 30x - 9)/2.50 

7 1/ = cif' 4- 1 4- ^ 2-rc* + 

9 y r\ cos X 4- fa sm x 4- 2 cos x 4- sinx) 

11 1/ = cic 4 caxc^* 4 *2 ~ ''io(3 cos Jj - 4 sin 2x) 

13 A =“ I 16 ?/ = e"’*(6 sin x — 2 cos x) 4- 2e* 

17 In the limit when tu—» A, 1' becomes — {( voa kt)/2k, which is the jiar- 
ticular integral tliat would hu\e been obtained by applying the methf>ds 
of this section to the equation y" -j- k'^y = sin kt 

1 1/ = 4 czxe' *' — In jxj 

3 y — nc"* 4- caxc"* 4- ^ 4 x ^(2 In 1 j| — 3;c"* 

5 ^ ^ ^ _ A In |j. 4. i| 

2 4 2 2x 

7 = — ' 2 -c jxl — X In jx! — x 

1 

9 y = (n4f,)x ^ cae”"* *>’^4-/ [e"'" *' — t ■ y 

2h Jo 

11 y ^ tit '"-' I C 2 xc““' ^ jo ^ d-** 


1 

3 

6 

7 

9 

11 

13 


y = C[f ^ 4- Cac”** 4- Cse 4- x — 3 
y = Cic f cos X 4 - Cl sin x) 4 3 cot x — sm x 

9x^ 4-16 HIP 2x 

y — cie^ 4- taf 4- to cos 3x 4 t4 sin 3x-~ ^»5 

1 / = Cl 4- caf^ 4 cos (V3 ^ sin (\/3 i/24 - xV3 

4f' 4 - 5c* cos x - 2 am x 

«o ■ ,0 ■■ 

^ ' 3 (2c-* 4 - 3 co« X 4- sm x) 

1 fJf 

Y = / (<.'-• - 26'-^^*'*' 4 -ds 

2 Jo 


1 y “ Cix 4- Czx In |xi 4- Cj/x 


c. ra . -c , , 

ty * ~ 4- ^ ^ - -I- 4 - 2 

* Vr ^ 


7 2Tr \/ hw/pg, where p ib the density of water 
9 r ■= a cosh ut 

io*(xo — 3ii) 


11 In each case the deflection is equal to 


6EI 

Xi*(ii - 3xo) 


dEl 


X] ^ Xq 
X i S Xo 


C2n 4- I)tx ( 2 n 4- 1 )V»£;/ 

18 yn ” sin -—ttt- ^ » 


2L 


4L* 
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16 The critical speeds and the associated deflection curves are 


Zn'EIg 

(J_ B - 

ApL^ 

and * 


(cos Zn — cosh Zn) ^COS ^ “ COSh 2* 

^sin Zn - sinh 


-I- (sin Zn -f sinh Zn) 
where Zn is the nth one of the roots of the equation 


17 

21 

26 


cos 2 cosh 2 ” 1 




kr^g 

WR^^Vfg 


1 / * a cosh \/ g/L t 
^ . I [2k 


19 

1 

/ 3kL^g 

2ir 

yjSWn 4 

23 

1 

U,, B _ 

\ 3(irT u»)L» 

(b) 

1 

Ikih 4 / 2 ) 

"" “ 2. 

\ / 1/2 


Chapter 3 

tec. 3.2 

p 72 


1 X * 4, 1/ » ‘ - 5 

3 I ■=» C\e* -H c*€“** — 

y - H(-3cif‘ - hcje-** + e'* + 16) 

6 X - cie“‘ -H — (14 cos 2t 23 sm 20/29 

y ■“ }>i[2cie~* -{- C 2 €“®* — (88 cos 2/ + 104 sin 20/29] 

7 X = c“'(i4 cos < + sin /) 

y “ — + B) cos I — (A — B) Bin t] 

9 X -» C) cos f + Cj sin f -h Ci cos 21 C 4 sin 2t -|- cos 3f 

1 / * H(2ci cos t -h 2ci sin t ~ 7c* cos 2f — Ic* sin 2f — cos 30 

11 X - (Cl + l)e-‘ + cte-*^ 4- llcie« 

y - -2cic-‘ -h cte-** -h 3c,c« -4 1 
2 “ cjc“‘ -h cj€' — 29c, 

18 X ™ c‘, y — cS and 2 * c‘ 

16 X — cie“* 4 c,e‘ 4 sinh (x — «){—z"v») — 2 '(a) 4 2(8)] da 

y “ cic“' — cje' 4 sinh (x — «)[ —2"(s) 4 2z(8)] ds 

z z (z arbitrary) 

17 (5D - 4)x - (4i) - 6)y - 0 (/>* - 2£>)x 4 (/^ - 2)i/ - 0 

19 Qi - 100(1 - c-*'*®), Qj - 100(1 4 


sec. 3.3 

p. 78 


1 X - cie-« - }i,y •• c,e-« 4 H 

3 X — cie' 4 2cae“ 4 0 y “ — cie‘ 4 c»fi’' 4 1 

6 I - -2ci 4 c,e-« 4 %e* 4 \ie-^ 

y - Cl - 3c»e“*< - 4 

7 X “ — 2ci cos t — 2cj Bin < 4 c, cos 2f 4 Ca sin 2f 4 }>i{5 — 3t) 

y “ 3ci cos t 4 3 c 2 Bin t — Sc, cos 2t — 3c4 sin 2t — }>i{7 — 50 

9 X “ 8ci cos 2t 4 8c* sin 2< 4 Cj cos 3/ 4 c, sin 3/ 4 3 cos i 

y - -7ci cos 2f — 7c* sin — c, cos 3f - C4 sin 3< - sm I 



Chaptar 4 

sec. 4.1 

p SO 


sec. 4.2 

p 07 


sec. 4.3 

p 106 
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8 (a) 


(b) 


(c) 


(a) 

(c) 


13 /(jOiTi, 


P{x) * 1 -h -f The difference table can be con¬ 

structed by addition from the leading differences 

P(0) - 1 ^/^(O) » 0 - 6 A'PfO) = 6 

P{x) “ —2(3*) + -j- 4- The difference table can 

be constructed by addition from the leading differences 

p{0) - 0 aP(0) --2 A='/^(0) - 2 - 24 

aV^(O) » 24 

P{x) - 6 -f 2(x) -b 13(j)(^> -f -b -f The dif¬ 

ference table can be constructed by addition from the leading 
differences 

7^(0) » 6 ^Pi^)) = 2 a740) = 26 A'P(O) = 102 

A^P(O) = 192 A®/ 40 ) « 120 

F{x) - -- 2(i)-(’>, (b) F{x) - (t) - 2(x)-^*), 

F{x) - (x)-<“ - 4 (t)'(») -4- 4(t)-(>) 

fix,) 


,Xn) 


■I 


n ~ 


»-0 


(a) 1 338, (b) 2 819 

^ 7^+_X|_/ (Xo,X t) _ 

2 2/(xo,Xi,X2) 

[/(Xo,X,) -/(Xo,X2) +/(x,,x.)]» 

Vmmx = ?/' ' Ate \ 

4/(Xo,Xi,X3) 


B -b 5i» 4 X - 2 


1 /'( 200 ) - 
/"( 200 ) » 
/'"( 20 ()) = 
/T205) - 
r'(205) •= 
/'"(205) - 


0 00500000 
-0 00002499 
0 00000024 
0 00487806 
-0 00002377 
0 00000025 


}iin 4- l)=*n* 


exact value =» 
exact value = 
exact value = 
exact value = 
exact value = 
exact value =- 
6 7 486 


J 

sin X 

/ - dx 

yi X 

1 

n sin J 

Jx X 

0 F 

0 946 

' o~(r" 


0 1 

0 846 

0 7 

0 265 

0 2 

0 746 

0 8 

0 174 

0 3 

0 647 

0 9 

0 086 

0 4 

0 550 

1 0 

0 (M)0 

0 5 

0 453 




0 00500000 
- 0 00002500 
0 00000025 
0 00487805 
-0 00002380 
0 00000023 


dx 


When the ffrst difference correction terms are taken into account the value 
of the integral is 0 31028 When the correction terms through the third 
differences are taken into acrount the value of the integral is 0 31027 


Cl - c, » 


13 


1 , 

f „ *Vo , 

36‘/o 


" IT 

640 

16 

(a) 

Cq 

— Ci — ; Ci 

- Ct 


(b) 

Co 

- c, - 'Hi, 

Cl - 
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MC. 4.4 

p 116 


y, - -1 7378, y, - -2.1603 
y, - 1 1103; ys - 1 2428, y, - 1 3997 
yi - 0 1050, y, - 0 2198, y, = 0 3445 
zi - 0 9998, 2s - 0,9986, 2> » 0.9955 

Like Milne’s method, the Adams-Bashforth method requires that the 
first few values of y be eomputed by other means, say by the Range- 
Kutta method or the evaluation of a senes expansion for the solution Tn 
particular, in the present problem only the values after y(l 4) can he 
obtained by the Adams-Bashforth method 


y(l 1) 

» 1 004S 

y(i2) 

- 1 0187 

y(i 3) * 

1 0408 

y(i 4) 

= 1 0703 

yd 5) 

- 1 1065 

y(l 6) - 

1 1488 



1,901 , 

1,387 , 

436 , 

637 , 

Vn + l “ 

yn + 

720 

’ 360 

-i- j yn~i 

- yn-i 




251 


\ 





V'n-A - 

j (open 


/ 

'251 , 

323 , 

44 , 

53 , 


yn -h hi 


b — y„ — 
360 

120 

360 


19 

720 


Vn-i 


11 


0 0 
0 I 
0 2 
0 3 
0 4 
0 5 
0 6 
0 7 
0 8 
0 9 
1 0 


y (by numerical 
.solution) 

I 0000 
J 0052 
1 0214 
1 0499 
1 0919 
I 148H 
1 2222 
1 3138 
1 4256 
1 5597 
1 7184 


y (from exact 
solution) 

1 0000 
1 0052 
1 0214 
1 0499 
1 0918 
1 1487 
1 2221 
1 3138 
1 4255 
1 5596 
1 718.3 


(closed formula) 


13 


16 


90' 


Vo 4 - 


(- 


yo + yi 


- 






6 


y 2 ” -yo 4 2yi -h y'/^* 

An accompanying closed formula can bo obtained by fitting a polynomial 
to (which can be obtained from the given differential equation as soon 
as an estimate for yj is available) and any three of the data yo, yi, Vi 


tec. 4.5 

p 125 


(a) y - ri(-3)^ + caf —4)*^, (b) y = 

(c) y “ 2‘^^(A cos '^^TTi -h B sin wx), 


(-.3)* 4- C2x(-;3)^ 

(d) y “ cj2* -b 023* 


(a) y - r,3- -b C 2 (- 2 )* - -- (6j + 1) + ~ x 3* 

.3o 1 !} 

irx iri sin X 4- am (x - 2) 

(b) y - J cos — 4- Bin -- + --7—-— 

2 2 2(1 -b cos 2) 
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sec. 4.6 

p 142 


7 V 


9 Z)„ 


sin ( n - j V 

y 0 

sin Tifi 
n — X 

V, 


sink (n — x)^ 

r'~” — Vo fi 

Sinn Tifi 

1 + n 
sin (w 4- 
sin n 

(-lr(I 4 n) 

, ^ Hinh (n -f 1)^ 

(-ir* — 


2it 4- 1 


nosh"' 


cos n 


cosh i 


2k 4- 1 


k <H 
k ^ 3i 
k > ^ 

X - 2 
-2 < X < 2 

X --2 

X < -2 


sinh tt z 

16 (a) The only solution is ^ = () 

(b) y - 0(x - 1) 

(c) Because = 0, the e^iuation js actually of the first order, and its 
complete solution contains only one arbitrary lonstant' 


Id) 


(-i)’ 


tto 5^ 0 


4 4*(j — 1), where 4'(j) is a particular solution of 
the nonhornogeneous equation {a^E 4 aj)i/ “ 0(x) 


1 (a) y = (2 -h 13.V)/102, (b) y = (-68 4 1H7 j)/133 

3 (a) T = 1 683. y = -1 847, (b) j = 1 730, y = -1 811 

6 (c) j « ^nPnoix) - ^inl\i(x) 

» '^(2rr- -h n)Pn,{x) - + H{n^ - n)P^2(i) 

7 (a) .1 = 1 000, a = 0 401) 

(bl Using the results of part a as an initial approximation, linearizing 
via Taylor’s senes yields A = 0 OO.*!, a =* 0 498 
11 After a has been lound, t may be determined by applying the method 
of least squares to the equations 


i/i = Ae*'*', vz = , iin = 


13 

16 


in which A is the only unknown This method is generally to be preferred 
to linearizing by taking logarithms, because it does not introduce any 
unwarranted weighting of the data It is clearly preferable to both this 
and the use of Tn>lor’,'? senes on grounds of simplicity 


/60 3\ /720 60\ 


0 980 ~ 0 4l8i* 


p » f cos 6 y sin d 


Chapter 5 

sec. 5.3 

p 163 


6 

18 

17 

19 

81 


The first integer equal to or greater than 


In 2 

^ir 


Vi - (c/c,)' 
Cicc 


tm^x “ 1/WnJ Vmax “ Va/unt' 

y = -e-* «(2 cos 14 4t + 7^2 Bin 14 4f) 
y - cos 8f 4- ^ sin 80 -h 2 

Period =" r * 2ir y/a/ng, where 2a is the distance between the axes of 
the rollers From this g * 4ir’o/j^*. 
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23 The maxima of the magnification ratio curves of Exercise 22 occur where 
w/(u„ - l/\/l — 2(c/cc)*, which 18 always greater than 1 for 0 < 
c/ce < that is, whenever a maximum exists 
26 The amplitude of the steady-state response vanes between the values 


— CJl* tiJ* — Wj* 


ti>® — WI* W® — CJf* 


MC. 5.4 

p 170 


1 Across the resistance* E ^ iR 40(c“*“®‘ — 

dt 

Across the inductance E ^ L— - 8( —-f- 
dt 


1 ft 

Across the capacitance ^ 


t dt 8(3 - 


3,125/ 

3 , - -e-ii.5oot 

2 

325/ 

7 I « -g-a.eoo/ 

2 


6 i„ - 0 14 cos {\2(ht + 19“40') 


9 / = 0 00039 sec 


18 |Z| is a minimum (or 1/|Z| is a maximum) for the undamped nntural 

frequency — l/\/For the magnification ratio the maXirnimi 
always occurs at a frequency below' the undamped natural frequenrv 
This involves no contradiction, since the magnification ratio M relates 
F and y, whose electrical analogues are E and Q, whereas the impedance 
relates E and t =» dQ/dt 


16 |Z| - R^ l -bQ* 


£ _ 

On q) 


5 =- Tan-1 Q 


(SL _ 

\pn n/ 


SBC. 5.5 

p 178 


1 1, 2 8 1, \/5 

6 ii - ^^(cos t d- 2 cos 2/), Xi “ ^ — cos 2/) 


7 eVe, 12\/5 


60\/LC 


/ t t \ 

I 16 Bin -;= 4- Rin ——7=; ) 

LC\ 3 y/LC 12 \/^C/ 


„-I 4 gjn-_ nn — 

20 \ 3 \/LC 12 


240 3 ^/LC 


-““vfe) 


- „ [c /243 3/ 1 / / 

11 ii ^ Eo ^ — I -sin —-sm ——— sin — 7 = 

\L\80 y/i^c 240 3 yjEC y /1 

„ /c/27 3/ . 1 t t 

*1 " -Oo a/t I - -;= -b - Bin -— Bin --t=; 

\ L yo y/ic 30 3 y/LC y/LC 

2 Nt 

18 UN - —7= Sin — /V - 1, 2, . . , (n — 1) 

y/LC 2n 


-• 2 ^ sin —- 

\Af 2(n-b 1 

o /^ ■ 

“ 2 A/ir s>n- 

\M 2 n -b 1 


N ~ 1,2, 


N ~ 1,2, 
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1» (a) Q, 

(b) Q, 


Eq Ic sin {n — fc 1)/* 

— -V / — ---- 008 (at 

u \ L cofl }i(2n + l)n 


008 M “ 1 


/ (n - /c + l);i 

(— i;* — ^/—-- ^ ^ —-— , - COB (at 

(a \ L smh }-^{2n + 1)^ 


cosh M 


(7Lu,« 

2 


CL(a^ 

2 


- 1 


Chapter 6 
sec. 6.2 

p 188 


0 

1 Oo “ flu = l/nir 

— 1 /riT 


3 a« 0 

6 tto “ 2 


ir(4n*~-~T) 


a, - 0 n •= 1,2, 3, 


7 a,» « 0 




( -!)>* •H 2 

nir 


n 2, 4, 6, 
n - 1, 5, 9, 
n - 7, 11, 

[ iMir 

bn ” I 2/nir 

lo 


n - 1, 2, 3, 


n — 1, 3, 5, . 
n = 2, 6, 10, 
71 - 4, 8, 12. 


( 3/nir n - 1,2, 4, 5, 7,8, 

I 0 n - 3, 6, 9, 


9 cto 

11 On 


13 ao 


li! 

3 


0 

2 


dm 


6, - 


(_l)n+14 

n* 

-2! nit 
-4/nT 
0 


n - 1, 3, 6, 
n “ 2, 6, 10, 
71 - 4, 8, 12, 



71 odd, 71 1 

n even 



bn 


0 


271 

^(1^ n») 


n odd, 71 1 

n even 


sec. 6.3 

p. 195 


3 On 


6 ao 


2(1 - o-Q 
1 V 47iV> 




7 oo -- 


4irn(l - e->) 
1 4- 47l*ir* 
271T_3_ / ^ 


27lir\ 


1 2nr 3 27iir 

n-1,5,9, 

7iV> n'r* 


16 

7lV> 

7iV» nV* 

8 

nV 


71 - 2 , 6 , 10 , 

71 - 3, 7, 11, 
71 - 4, 8, 12, 
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sec. 6.4 

p 200 


9 Yes In particular, the Fourier expansion of 




0 S t ^ I 

4t* - 2t* -h k(t + 1)»<V(0 -1 g < ^ 0 


where g{t) is any function possessing a continuous second derivative 
will converge to t for 0 < ^ ^ 1 and will have coefFicients decreasing 
as 1/n* 

11 Since 1/(2 + cos 0 possesses derivatives of all orders at all points m the 
interval 0 ^ ^ 2ir, the Fourier coefficients of this function will decrease 

faster than the reciprocal of any fixed power of n (See Exercise 29, 
vSec 16 2 ) 

16 On Will decrease faster than 1/n* provided that, for all values of n, 


y - f'itr)] coa — t - 0 

iU p 


where (M is the set of points of discontinuity of /' 

bn will decrease faster than l/?j* provided that, for all values of n. 


X - /'(«• 


mrt 

■'(ft“)) Bin- 1=0 

V 


where |<,} is the set of points of discontinuity of/' 


2(1 - cos 


( 1 — cos 

sin 1 2 ^"^ / 


/ nir\ 

I 1 — cos — I n ( 


2 nir 

— sin — 
mr 2 


( sin ^^Tlir \ 
1 — cos ^^TlTr/ 


( 1—2 cos -f cos nir\ 

sm ^' 2 mr ) 


Sn “ tan“ 


sin 

2 cos l^ntr -f cos 1 


(1 - «■""') Co - H 


1 6 “*”**’ 

7 c„ - - (e-a"**- - 1)- 

4n*ir’ 2mir 


2Tr 1 - 4n» 


MC. 6.5 1 The complete solution will originally appear in the form j/ ■■ cij/i + 

p. 205 ctyi + Y, where Y is the Fourier senes obtained as the answer to Exam¬ 

ple 2. Imposing initial conditions of displacement and velocity will thun 
lead to a pair of simultaneous linear equations in ci and Cj in which the 
constant terms will involve the infinite series which result from the 
evaluation of Y and Y' when t — 0. Although there is no theoretical 
problem m determining ci and C| from these equations, the arithmetical 
complications are obvious. 
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sec. 6.6 

p 210 


sec. 6.7 

p. 220 


8 i/„ - 0 190 sin {2^1 - 3 2«) -f 0 142 sm {M - 22 3®) 

-f 0-047 am (10ir< - 159 8®) -f 0 011 sin (14iri - 171 2®) 4- ■ 
8 V» “ 4- 0 225 cos {ift -3 2®)+ 0.171 cos (3iri - 22 3®) 

+ 0.056 cos (5ir« - 159.8®) + 


7 



200[600nir + i(200nV* - 1,250)] 


(Note Tlie term corresponding to n * 0 is to be omitted ) 


1 

8 


6 


Six) - 2 445 - 0 939 cos x - 0 378 cos 2i - 0 230 cos 3x 

— 0 167 cos 4x — 0 133 cos 5x — 0 113 cos 6x — 

“ 59.46 - 20 99 cos i - 0 42 cos + 0 17 cos 4< - 0 02 cos bt 

4 0 06 cos 7« - 0 08 cos 8/ + 0 01 cos 10/ 

— 8 94 sin t — 0.20 sin 2/ f 0 20 am 3/ + 0 43 sin 4/ 

— 0 07 sill 5/ 4 0 02 sin 7/ 4 0.03 sin 9/ 

— 0.05 Bin 10/ 

Toxin “ 45.08 - 19 66 COB / - 0 27 coa 2/ 4 0 89 cos 3/ 4 0 04 cos 4/ 

— 0 06 COS 5/ — 0 04 COS 7/ 4 0 04 cos 8/ 

— 0 05 COB 9/ 4 0 02 cos 10/ 

— 9 41 sin / 4 0 28 sin 2/ — 0 20 sin 3/ 4 0 36 sin 4/ 

4 0 18 sin 5/ — 0 17 sm 6/ — 0 25 sin 7/ 

— 0 07 Bin 8/ - 0 03 sm 9/ 4 0 09 sm 10/ 

If m 18 SO large that all coefficients after b„ are negligibly small, the for¬ 
mula of the exercise expresses in terms of selected values of the given 
function which either will be known or can easily be found By repieating 
this process for decreasing values of m, using previously computed coeffi¬ 
cients where appropriate, the coefficients down to and including hi can 
be approximated. 


2 1 — cos u>n 
1 (a) On “ 0 6n “ - - 


(0 


(b) ao 


2 1 — cos (On 




(c) Of 

w 

(d) Of = 0 


4 Bin (On — (On cots (On 


t-’f" 

2 Bin 


Au 


b„ ^ 0 (On 

» 0 Wf 


COn 


2a f 

(a) SW--I, 

(b) fit) - i /„' 


bn “- 

IT* - 

COS (ot 


d(o 


o» 4 

1 a COB w/ 4 w sin (ot 
o* 4 w* 


d(o 


2 /■« sm Tw 

fit) - - / —- sin (ol dto 

^ r Jo 1 - Ol* 

2 /■• COB \^ir(o , 

(d) fit) - - / --r cos u do, 

r yO 1 — w* 

sm «(1 — /) 4 Bin (ot 


(e) fit) 


1 r • sm (a 

w Jo 


d(o 


4 /■ • sm io — di cos (o ^ . 
(f) m - - jf, —— - 008 od do, 


riT 

P 

ntr 

P 

riTT 

P 

nr 

p 


Ao) * — 

V 


B - 
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Chapter 7 

sec. 7.1 

p 232 


sec. 7.2 

p. 236 


sec. 7.3 

p 241 


sec. 7.4 

p 253 


. 2 /■o»t 1 — cos w 

6 /(/) * — / ---cos ut dta 

w Jo ta* 

1 


--[(«- 1) Si «o(< - 1) - 2< Si wo/ + (< + 1) Si wo(/ 4- 1)] 


9 Y 


2 r- 1 — c( 

T Jo W* 


1 — cos w (6 — w*) cos uli + aw sm w/ 


c/w 


(6 - w»)> 4- a«w« 

11 -- f M(ca) f f(s) cos (wa — w/ -|“ £i((w)] ds dw 

irk JO y - • 

where k is the modulus of the spring m the system, M(u)) is the magnifi¬ 
cation ratio, and a(w) is the phase angle 


6 No; for instance, the abscissa of c ' is aro =» — 1, whereas the abscissa of 
convergence of e~‘ dt ib aj « 0 


1 £|/<")|.- .-£ 1/1 - ^ 


31 




J-0 


9 If T(f') and T(f") are not to involve the evaluation of / or any of its 
derivatives, it is necessary that 

K(s,a) - K(s,b) - 0 


and that 


dK(.9,l) 

dt 


dK(8,t)l 


dt 


If 0(s,/) 18 an arbitrary difTerentiable function which is bounded at < = u 
and at / “6, these conditions are met by any kernel of the form 


K{8,i) ■■ (/ — a)*(/ — 5)’^s,/) 


- (- * \ 
2 \» '*’ «* + 467 


«« - 6« ■ 2 ' 

6 (a) (b) H/*. (c) M sin 3/, (d) 2 cos 3/ + sm 

(e) - e-0 

7 1/ - M{-2e-^ - 3c-* 4- 5c*), z - H(c-« + 2e-* - c*) 

9 (a) r(H) - 1.7725; (b) 2, 

(C) H 4-r(^^) 4-r(^) - 2 1291; (d) r(c 4- l)/(ln c)- 


1 “h 28 + 2s* 

8 2-;-c-*- 


8 - 2 


9 - c-**-< 


18 


17 cot”' 


4(8 4- 3) 

(8* + 6s + 25)* 
8 + 3 


7 

11 

18 


1 -hc- 
8* 4- 1 




(8* + 68-1- 13)* 


19 - cos-* —-— 

8 2 


/»e-” 

6 


28 


K' 


2 / 


COB-h c-*'* sin 


2/\ 

3 / 
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m 


26 

t - 

1 -hc-‘ 

27 

29 

it - 

1 )*«-(*-!) 


2 

81 

38 

1 + 

e~* — 2 COB t 



t 

36 

87 

Hte 

■** sm t 

89 


27 Bin - 2)u{i - 2) 

g-hi _ --al 


fi Sin t 

JO ~r^ 


/(O, r(t), and /"(O are each piecewise regular and of exponential order; 
/(O, and f"\t) are each piecewise regular and of exponential 

ordir 

n — 1 

/<")(0+) - lim sffl-iil/l - y 

j -»0 ^ 

;-0 

48 -h 2««-‘ - 36-«) 

46 e-‘ - c-“ -h \i{\ - - 1) 

47 sin t 


sec. 7.5 

p 259 


1 H(5c-‘ - 18e"« + 15f-«) 

3 H5(3 cos < -f 4 sin i - - lOfc"’') 

6 Ho[3e' — 5c“‘ -f 2e"*'(coB t — 2 sin <)1 

7 ^ (e- - 

4 

9 1/ - - 3c‘ -I- + 14(3 + - 3c*-* - - 2) 

11 1/ =« -I- 2t -f- - cos / - sin t] 

J0( 14 14 + 4< 

13 ^ - 2 

+ j _ 5 4 a - 1 ) - ^ - D’ 4 [5 + e— j 

4t 6-1- 2t 

y „ --|_-2 -1--€-‘ 


tec. 7.6 

p 269 


1 . 7 r« ^ 1 - (1 -H as)c 

8 -coth — 0 -; Z7~i 

1 + s* 2 »H1 - C >“•) 

7 ->^(«.(r,l,2) - 0.(<,1,2)1 + ?ilM>-,2,2) - (1,2,2)] 

+ Ho[-<>.(t, 0,1,2) - 0,(<,O,],2)j 4- Ko[*i(’-,l' 1,2) - «,((,0,1,2)| 

9 [(-l)"0.(r,l,l) 4- *.(1,1,1)] - 1(-1)"*.(t,2,1) 4- *.(1,2,1)] 

- 1(-1)’‘*i.(t,2,1) 4- *,.(1,2,1)] 
11 y - -e-‘ + 2e-*‘ 4- [(-1)"*.(t,1,2) 4- *.(1,1,2)] 

- [(-l)"*.(r,3,2) + *.(1,3,2)] 

19 Proceeding naturally (though eomewhat incautiously) we obtain at once 


\a 1 4- s7 1 -h e- 


and y ■■ ~ + 4>e(^0,l,x)] 

However, 




cos (l -H it) -I- COB X 0 


2(1 -h cos it) 


778 


ANSWERS TO ODD-NUMBERED EXERCISES 


sec. 7.7 

p 280 


The reaflon for this i8 that the term of lowest frequency in the Fourier 
expansion of the driving function /(<) duplicates a term in the comple¬ 
mentary function A cos f H- B sin i, and it, though not the rest of the 
terms, must be handled in a special way when the necessary particular 
integrals are obtained To circumvent this difficulty, it is convenient to 
write the second term in £(?/) in the form 

- ^ (I - c-'* + c-*" - ) 

1 -h s® 

Then, taking inverses, term by ti^rm, we find 
V ^2(^j7r) — 0i(<,ir)cO8 i 


sin 2i — 2t cos 2t 

— 


3 6(0 - 2c-« 


5 )'^{sin cos 30c~“ 

7 k‘» - X) dX - {t - X)c-“('-^/(X) 

1 - 2c-‘ -h e-« 


d\ 


11 A{i) 


h(t) » c ' — p “ 


13 ^(0 - Hi X - c 

h(t) « -l^^^e'^ooot _|_ 1 ^ 2 ^,-i.ooor/e 
t,(0 = (-iKif”'”’' + 

19 (a) = 


(b) u{t — a) *J{t) 


0 


t 

t < a 

\)d\ 0 ^ a ^ « 


(c) r * 


m’n! 


(m -h n -f !)• 


+n + l 


Chapter 8 

sec. 8.2 

p. 293 

sec. 8.3 

p 299 


7 (b) No 

1 y{^^) " '^(1 — |x — ai|)(?i(j- — a/ -f -1) — n{x — a/ — 1)] 

4- '^(1 — 1j 4- oil)[u(x H- a/ -H 1) — u{x -h a/ — Dl 
3 7/(x,0 »= COR (t - aOKx - + Tr/2) - u{x - at - ir/2)] 

f cos (t H- of)[ii(x H" at -h 7r/2) — u(x -j- at — t/ 2)1 
5 y(x,0 =• }^(x — “‘bv(x — at) + (x — at)e’^‘^‘u( — x -h at) 

4- ^^(x 4“ 4- at) 4 (x 4- o0e*'^“'w(—x at) 

7 0(x) “ — (1 -}“ cos x) X < 0 
9 ^x) " (1/a) cos x[u(x -f tt) — 7i(x - tt)] 

11 If /" s 0, that IS, if / 18 a linear function, then the given equation is 
identically satisfied without restriction on X If / is an arbitrary, twicc- 
difTerentiable, nonlinear function, substitution into the given equation 
yields (aX* -f 6X -|- c)f" = 0, and this will be satisfied identically if 
only if X is a root of the quadratic equation aX* -f- h\ -f- t =* 9 Accoici- 
mg as — 4ac is greater than, equal to, or less than zero, this equation 
will have two, one, or no real roots, as asserted 
X — at * Cl, X 4- af — C2 


13 
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SBC. 8.4 

p 309 


15 The two-dimensional wave equation has solutions of the form 
* fix — at) -f Fir -f a/) 4- oiy — at) G(y -|- at) 
and also of the form 

uix,y,t) « /(x -1- 1/ - \/2 aO H- Fix - y - \/2 at) 

-\- g{ —X y — \/2 at) Gi -X — y ~ \/2 at) 
where f, h\ g, and G are arbitrary, twicc-differentiable functions 

^ Jo dj- »= 0, ^ gix) dx = 0 Physically speaking, the first condition 
implies that the integrated initial angular displacement is zero, which 
will alv ays be the case if the origin of 0 is suitably chosen Since the shaft 
IS of uniform cross section, the second condition implies that 




ldix,0) dx = 0 


i: 


which IS precisely the statement that the total angular momentum of the 
shaft is initially (and heme permanently) zero In other words, 

g{x) dx “= 0 implies that tlu vibration being studied is not super- 
piosed on a uniform rotation 

(a) Yes, (b) yes, (c) yes, (d) yes, (e) no, (f) yea 

' 0 n even 

V ^ TlirT TJ-fr/lf I 

0ix,l) 


nirx nirat 

/ ,4n sm - cos where An 


I 


—- n odd 


Doubling the tension multiplies the frequency by \/2 Because it is 
easier to change the length cjuickly and accurately tnan it is to change 
the tension 


9 yix,t) 


2^ Bn Sin f 


nirat 


where 


(-l)n-H4/2 

nV’a 


n even 
n odd 


11 


13 


Vix, 

where 


V nirx ( nirat nirat\ 

,t) = ) ' “ I ^1" --- - Bn sm ~ j 

n * 1 

41 




Uo V 

.(.,0 -2 + 2 . 


I n 7^ 1 


Bn 


nirx 

cos - — 


n-jr nw 

-sin — Bin — 

n*ir*o 2 4 


where 


.4„ 


n even 
n odd 


I " 

1 —4voln'^ir^ 

16 The nonniil inodes of a uniform shaft of length / vibrating torsionally 
with its left end fixed and its right end free are given by the formula 


(2n — Dttj 


1, 'A 3, 


and the corresponding natural frequencies are 4f/(2ri — l)a For a 
similar shaft of length 21 vibrating torsionally with both ends fixed, the 
normal modes and natural frequencies are, respectively. 


21 


and 


4/ 


I, 2, 3, 


ma 
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sec. 8.5 

p 327 


Obviously, for every value of n, the nth natural frequency of the first 
shaft IS the same as the natural frequency of order w * 2n — i of the 
second shaft Moreover the nth normal mode of the first shaft is clearly 
congruent to the portion of the (2n — l)8t normal mode of the sec ond 
shaft which lies between 0 and I The converse is not true, however 
for neither the normal modes nor the natural frequencies of even order 
of the shaft of length 21 correspond to possible free motions of the shaft 
of length I 


3 z, - 2 03, 22 - 4 91, z, =■ 7 98, = 0 73, 

6 u “ ^ cos where 

and the z’s are the roots of the equation cot 2 « erz 

7 w = 70-f y cos f y j j w here 


“015, /iji “ 0 06 


Zn “h Bin Zft cos j 


7 w = 70 -f 


Zn -h Bin z„ r 


and the z’s are the roots of the equation cot z » az 
11 In each case the natural frequencies are “ z^’a/f*, where z„ la the nth 
one of the roots of the indicated equation 

(a) Ilinged-hinged sin 2 ■= 0, Xn “ am Zi,x// 

(b) Fixed-fixed cos z cosh z = 1 

Xm “ (sin z„ — binh z«) (^cos — cosh 


— (cos Zn — cosh r„) ( am 


(c) Free-free, cos 2 cosh 2 = 1 


Xn = (sin Zn — smh z„) ( cos ^ -f cosh “ ] 


(cos Zn — cosh Zn) f SID -j —h sinh - 


(d) Fixed-hinged tan z «= tanh z 


(sin Zn — sinh z„) f — cos ——I cosh 


-h (cos Zn — cosh z, 


“) 

, / ZnX 

.) -- 


(e) Free-hmged tan z = tanh z 


Xn “ (sin Zn “h sinh Zn) 


— (cos Zn -h cosh Zn) 


( . ZnX 


18 Assuming the beam to be hinged at i -» —I and at i ™ Z and to bear a 
mass A/ at j " 0, the frequency equation is 

sin z[2 cos z cosh z — A:z(co6h z sin z — sinh z cos z)] « 0 

where z «■ \/ u/a I and k is the ratio of the attached mass to the mass of 
the beam. The factor sin z yields the frequencies for the modes of vibra- 
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7f1 


lec. 8.6 

p 336 


tion in which the mass remains at rest and each half of the beam behaves 
as a simple hinged-hinged beam of length I 
18 From Exercise 14, the normal modes are Xn “ sin (znxfl), where the z’s 
satisfy the equation cot z ^ rz and t is the ratio of the moment of inertia 
of the attached disk to the moment of inertia of the entire shaft From 

this it follows easily that XnX^ dx r sin Zn sm 0, since 

sin Bin =* 0 only if or z^ »« kir, and for these values cot z 9 ^ rz 


17 Since 


/_, cos mx cos nx dj — I ^ ^ ^ system is orthogonal 

on the interval (~ir,T) However, since j sin x cos nx dx “0 for all 
values of n, the system is not complete 

1 , Yes If the frequency of the impressed force is, say, Um -= mwa/l, then, 
for the term Cm sm (mirx/l) sin {mvat/l) in ip{x) sm (imrafl), assume a 
term of the form Dm Ism {mTrx/l)\[t cos {mirat/l')\ in the series of particu¬ 
lar integrals used in the second method 


3 Y 


V 4 - 0.=* I ) 


Sin u)t where 


4 nir nir 

' — sm — sm - 
nir 2 A 


If n < c/2iro, the time factor in the corresponding product solution is 
overdamped If n > cl2ira, the time factor in the corresponding product 
solution 18 underdamped If the string is acted upon by a forcing function 
sin (j)t, the natural assumption Y{x,l) = A{x) sm wf + B{x) cos w/ 
leads to a pair of simultaneous differential equations for .4(i) and B{x), 
and there is no simple extension of the concepts of magnification ratio 
and phase shift If the second method illustrated in Example 1 is 
employed and a particular integral of the form 


cos ui 


Dn sm sin wf + En sm 

IS assumed, then for each value of n the corresponding term m the par¬ 
ticular integral can be constructed using the concepts of magnificatioi' 
ratio and phase shift 

The analysis proceeds very much as in Example 1 except that the normal 
modes of the problem are cos {nrxjl) rather than sm [mrx/l) Hence, 
<t>(x) must be expressed as a half-range cosine expansion, and a similar 
assumption must be made for »(i) 

sm (z — k) -Y sm { sinh (i — {) + sinK ( 


-ag r8 
^ " pAV / 


sinh z 


- ^(z - 0 sin U)t 


where 


11 


ii:.L 


18 u — 


V (jj/al and ( " \/o3fax 

cos X« cos Xx da dX 


E 


cosh 2X — cos 2X 


Bin uU COB - 


cos utl sm 


^COBh(2-*)x 

— sinh ~ ^ ~ ~ 

(-?) 


Xi 

X cosh y 


-j- cos uit Bin I 


X sinh 


~i\ 
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where X — aZ y/ w/2. By applying thi8 formula to each term m the 
Fourier expansion of an arbitrary periodic end condition, the steady- 
state temperature distribution produced by such an end condition can be 
determined 

16 ©(i.Z) — j sin Xic[yl(X) cos qt + B(\) ein qi\ d\ 

+ cos {(lit -|- 

1 /■• 

where ^(X) — - / — EoC““* cos bs cos Xs ds 

T yo 

and B(X) - i ^ sin bs p A{r) sin rs dr j sm Xs ds 

17 ^ ^ ^ Bin ^ 

„ /-l ri /2m-f 1 \ /2n + l \ 

where “ 4 / / f{x,y) sin ( - - — irx j sm I—-— ny J dx dy 

16 u ^ i4n sinh nT(l — y) sin nrx 

n ■ 1 

2 fl 

where i4n " -rr- / f{x) sm mrx dx 

sinh nir yo 


I sm riTX dx 


21 The problem can be solved by superposing the solutions to the proble 
defined by the following sets of boundary conditions 

u{x,0) “ fx{x) v{x,l) =» u{0,y) “ w(l,y) ■» 0 

u{x,\) -ACz) u(x,0) “ M(0,y) “ u{l,y) - 0 

u{0,y) - giiy) u{l,y) =* w(x,0) * u{x,l) - 0 

u{i,y) - gt{y) u{0,y) u{x,0) - w(j,1) = 0 

28 (a) u - 100 (as should be obvious) 

(b) u “ lOOx (as should be obvious) 


(2n - Ih 


■ Bin 


(2n — l)Trx 


€•>11 " a \/m* -b nV2Z (m, n — 1, 2, 3, ), where I is the length of the 

edge of the membrane When the membrane is vibrating at a pure fre¬ 
quency the nodal curves are defined by the equation 

mirx Tiny TiTX miry 

A^n sm —^ sm — + Anm Bin ~~ Bin —~ = 0 

where Amn and Anm are arbitrary If either A^n or Anm is 0, the nodal 
curves are straight lines parallel to the edges of the membrane In gen¬ 
eral, however, the nodal curves are too complicated to describe explicitly 


fM. 8.7 

p. 343 


8 (a) e{x,t) - 


(b) e{x,t) 




a* niri ahji . wirx 

V --sm — sm (lit “b-- sin “t" / 

(nV*o*/Z*) — I n?r(a>* — n*ir*a*/Z’) Z Z 

The second term, whose frequency is different from that of the impressed 
force, is present only because friction has been neglected. Actuallyi 
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7t3 


7 

e 


die away rapidly in any realistic physical system The response of the 
string to a distributed force/(a:,0 « ^(t) sin or — sin (riTx/l) h{i), 
where h(l) is periodic, can lie found by first expanding g(x) or h(t), as the 
case may be, m a Fourier senes and applying the result of the first part 
of the exercise to each term 
fft* g 

!/ - ~ - x) 

2 2a* 


ii[e\ - 


a sinh (ax/a) 


When X - I this becomes 


a cosh (si/a) EJ 

hence, in this case e is the Morse dot function of pei 3d Al/a 


1 al 

~tanh —, 
a a 


Chapter 9 

sec. 9.1 

p 350 


sec. 9.2 

p 356 


sec. 9.4 

p. 365 


>Rc. 9.5 

p 371 


(a) J - 0, regular, (b) i — 0, irregular, 

(c) I — 0, irregular, x - 1, regulai 

(d) I ■■ 1, regular, i « — l, regular 


8 y 




(31)' 


(41)’ 


I* < » 


A second senes solution of this form cannot be found, since the indicial 
equation has equal roots 




2*211 5 

I* 


2»3!1 5 9 
x» 


X* < * 


-h 


2*2»7 11 2*3»7 11 15 ' ' x < * 

7 The point at infinity is a regular singular point of the given differential 
equation 

9 If the roots of the indicial equation differ by 1, the two roots lead to the 
same senes unless 6i(r — 1) + Ci — 0 Similar results hold if the roots 
differ by an integer greater than 1 For instance, if the roots differ by 2, 
the two roots lead to the same senes unless 

ln(r - 2) + Ci I 


(r - l)(r - 2) + 6o(r - 1) 4 c„ 
5i(r - 1) 4- c, 


6a(r — 2) + Cl 


- 0 


3 If xi were a common zero of Jyix) and /_„(x), then, from the result of 
Exercise 2, 


0 --sm vr 

WX\ 

which IS impossible, since y is not an integer 
2 




1 1 / - Vi 2 

8 y ^ x~'[ciJii(2 \/x) + CtYii(2 \i^)] 

6 v-V xe *[c\J^\(]ix^) 4-ci/-^(lix*)J _ _ 

9 V -c,Jo(2\/3x) 4-c,Fo(2 VSx) Cih(2 \/Zx) -H c«Ao(2 VSi) 

/384 72 , \ ^ . (192 12\ 

1 ^(i) - - 7, + ‘ j - 7 j 

8 -xJ,(2z) + 2iV,(2i) 
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MC. 9.6 

p 376 


tec. 9.7 

p 386 


19 (a) Ix'UoCx) sin x — Ji(x) cos x] -f xJi(x) sin i) + c 

(b) H lx*{Jt(x) cos X — J(,(x) sin x] + 2xJi(x) sin x| -f c 

28 2 \/1 •7i( \/x) c 

26 (a) i7.(x) 4- c (b) x^IM - xU{x) + /7o(x) dx -f- r 

(c) i7o(x) — /7o(x) dx + c (d) x*7,(x) -f c 


1 1 


3Xn»71 (SXk) 


6 x> 


n - 1 

- y -^2- 

x„/,(x,) 


•7 o(Xfix) 


JiO^nX) 


9 J(X)K(5X) - /(5X)r(X) - 0 


8 x 


7 1 


y 

W X»y o(2Xn) 
n - 1 

E 37^5 


J\{>^nX) 


-2 
(3X0(1 


1 

6 

7 

9 

11 

17 

21 


a 

{»' + a»)” 

(a) 1/X, (b) 0: 

«"•* e“J(i(bl) dt 

a 

(,. _ x*)« 

- J,(2 Vi) 

Vt 


V»* + (V«’ + X* 4- «)" 

(c) 1/X> 

(«> - X’)W 
16 Bin I — /Jo(0 


cosh \/ 2h/wk X 

1/ - 1/0 + (it* — l/o) - T- - —= 

cosh v 2h/wk a 

where w is the constant thickness of the fin. 


„ ^«',(xV«)/«(xVi)+ /i(?‘V«)^fo(x V^) 

Ki(\ V«)^o(X VO + VO 

where X — 2 V "^h/kw. 

26 0)1 »s 2,400 cycles/sec, a»a “ 5,600 cycles/set 

37 I - (1 + + c,/-M(?iX(l + a«)«|| 

where ci and cj are determined by the equations 


-h - xo 

-f ■» 0 


29 Using the first suggested method, the critical lengths are determined by 
the roots of the equation *■ 0 where a “ y/ApjEl Using 

the second suggested method, the critical lengths are determined by the 
roots of the equation 

cos V3 aZ -f " 0 where a — 



The first critical lengths in the respective cases are given by the formulae 



81 y 


Fo tan B 


[' 


and \ - 2.024 

Vx /o(2o Vx) "! 

aJi(2aVi) J 
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where a* = — 

86 The natural frequencies are the values of u determined by the equation 

where b is the radius of the drumhead. 

37 y,(2 \/i^al)h{2 y/Zal) - 7,(2 y/'^al)Ii{2 y/Zal) - 0 

where a® * ^ptEgh"^ 

39 uir,d,z) “ ^ ^ (-^nn* COS TIB “I" Ritm 310 TlO) Sinh (Xnm-) 

n —0 T» — 1 

where J^iK^b) “ 0 and 

2 r rGn{r)Jn{K^T) dr 

A _ ___ 


41 u{r,t) » 100 


6* ainh {^mmb)Ji{Xnmb) 

2 1^’’ rff.(r)y.(X.„r) dr 
sinh 

In r — In rj 




1 /-ar 

/o 

//«(r) - - f{r,e) am ntf 
ir yO 


I COB nS do 


In ri — In rt 

+ ^ e->-’‘'«'yl.[ro(X.r,)yo(X.r) - /o(x.r,)y',rx.r)l 


where K la the nth one of the roots of the equation 

y^(Xri)/o(Xr2) — /o(Xri)yo(Xrj) - 0 

and 


p rlKo(X,r.)y„(X.r) - /,(X»r,)Ko(X.r)l 


In r - In fi ^ 

100 --;- dr 

In ri — In rj 


ra’* 


Y [yo(X,r,)/x(X,rj) - J,{Kr,)Y,{Kri)V 


-^ iyo(Xi»ri)i/i(XRri) — i/o(Xnri)yi(X»ri)]* 


43 v(r,z) - J i4„J^o(Xnr) sinh (X^), where X» is the nth one of the roots of 
n " 1 

the equation c/o(X6) — X/i(X6) ■■ 0 and 

rb 


An 


2 r/(r)/,(X.r) dr 


6“ sinh (Xp;i)[l -{■ (c/X,)*]JoHXiih) 

and c (instead of has been used for the parameter in the radiation law 
to avoid confusion with the height h of the cyhnder. 


200 


n-l ^ ' 


sin 2n$ 


46 u(r,B) 


n 
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sec. 9.8 

p 398 


Chapter 10 

sec. 10.1 

p 412 


sec. 10.2 

p 428 


, _ PM + 2PM _ 3P.(z) + 2PM 

1 X ™ ^ z * 

' 2*ifcl \ (n - k)/2 


^ k, n both even or both odd 
7 w -• J Ur" -h Pn(cos 9), where A and B are determined by 


n — 1 

the equations 

B n + 1 /-ir 

B n 1 

>16.- + 


fl($) Bin (? Pn(C0B d) dd 

6"+* 2 lo ^ ^"(COB e) de 

[ 2n 2 *n(n - 2 ) 1 


H„2{x) » oi 


r 2 (n - 1) 
L^- - 3— 


- 1) , , 2\n - l)(n - 3) 

,3^--: 


The usual definitions are obtained by choosing ai and Oa so that the coef¬ 
ficient of the highest power of j* in each case is 2 " The orthogonality of 
the //’s follows from the fact that the given differential equation can hr 
written in the Sturm-Liouville form 


d( g~*V) ^ 
dx 


2ne~*'y 


0 


1 (a) 80, (b) 0, (c) 4 

7 />„ = aDn-\ — bcDn-t, if a = 3, /> =» 2 , c -= 1 , then Dn 

n 

9 []("'“ 

i,j = 1 

j>i 

1 Tlie product of the given matrices is 

^ ^ I the given expressions each Jyifld 


3 

7 

13 

3 


8 For X - 


6 

-10 


-10 

16 


For X - 

1 2 0 

0 3 0 

the given expressions each yield 

2 -2 0 

0 0 0 


0 0 4 


0 0 1 


The given relation is an identity for all square matrices X If A" is not a 
square matrix the given expressions are meaningless. 

7 ABj, where Bj is the jth column vector of B 
16 No; the inaividual submatrices must also be transposed, that is, 


17 The sum of the elements in any row, say the tth, is the Buni of the proba¬ 
bilities that the system goes from the tth state to some state Since this is 
certain, the sum of these probabilities must be 1 
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27 28 

o O'? I»*7 


sec. 10.3 

p. 436 


220 219 73 

11 219 220 73 

^ I 219 219 74 


1,756 1,755 585 

1,755 1,756 585 

1,755 1,755 586 


(a) If A IS nonsingular 

The inverse of an upper (lower) tnanguUr matrix is also upper (lower) 
triangular, and the elements on the principal diagonal oi the inverse are 
the reciprocals of the corresponding elements in the original matrix. 

1 3 1 

The inverse of the coefficient matrix is —3 -1 5 Multi- 

I 2 -2 2 

plying the matric form of the given equation by this matrix gives 

II II 

^ ” H 10 


lec. 10.4 

p 443 


5 

16 

28 

8 

28 

54 II 


SO 

-46 

- 

46 

44 


12 

-16 


9 Hint Verify that (adj yl)"^ = T/Ml Then, in the relation adj B — 
\B\ let B » adj A and use the result of Exercise 8 
18 |i^| - -A.u(A:i -j- ki)iki% 4- A.8i) - kik^iki^ + k^A - knkia{ki kA, and 
if all the A:’s are positive, this is obviously a negative quantity. 

j,, 112 5 8 I 

16 K~^ — elasticity matrix *-5 16 28 


stiffness matrix 


In this problem it is the elasticity matrix which is computed directly 
and the stiffness matrix which is computed as the inverse of the eh .ticity 
matrix In the example in the text it was the stiffness matrix which was 
computed directly and the elasticity matrix which was computed as the 
inverse of the stiffness matrix 

No, because if all minors of order p < r are zero, then, by expanding the 
minors of order r in terms of their p th minors, we see that they too must 
vanish, contrary to hypothesis 

f 3 X ^ J^,l,2 

(a) Rank " ] 2 X - 1,2 

I 1 X - H 

T. u / 3 X 1,6 

(b) Rank - I 2 j g 

[3 

(c) Rank - | 2 X - 

[ 1 X - 1 

(a) T\ column 2 — 2 column 1; Tj' column 3 — column 2; 

Tg column 1 + 2 column 2, T^. column 1 — column 3; 

Tb'. column 2 - column 3, T% - column 2 

(b) Ti. row 1 - row 3, Tj- row 3 - row 1, Ta row 3 - row 2; 

Ti - row 1 4- row 3, Tf,\ row 2 + row 3, T# - row 3 

0 -1 1 
p-i « -1 0 2 

1 1 -2 

A and B are equivalent since each is of rank 3 Hence in particular we 
can take P ^ B and Q “ A~K 
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tec. 10.5 

p 459 


If A is an (n,n) matrix of rank r, then AX 0 has n — r linearly inde¬ 
pendent solution vectors, and so does A^X ^ 0. If A is an (m,n) matrix 
of rank r, then AX 0 has n — r linearly independent solutson vectors 
but A^X “ 0 has m — r linearly independent solution vectors 
3Xi + 4Xj — 3Xi -f -Yi “ 0 , and from this each vector can immedi¬ 
ately be expressed in terms of the other three 


5 


-4 


1 

1 

-6 


3 


1 

1 

2 

+ C 2 

-1 


0 (b) X = 

0 

1 


0 


0 

0 

0 


1 


0 

0 


No, for instance, consider the matrix 


Its rows arc linearly 


dependent, but its columns are linearly independent 

Any (p,q) matrix of rank r can be written as the product of a (p,r) matrix 

and an ir,q) matrix. 

Note that A^^^X =0 implies A^'^^X — A^'^^X “ — 0 Now 

consider the possibility that ciY -h cjAA' -H • + CpA^X = 0 
Multiplying on the left by A* gives 

ciA'X 4- 4- - 4- c^A^'^X - O 

which implies ci — 0 Similarly, it follows that cj “ C 3 “ = Cp = 0, 

which proves the given vectors arc linearly independent 
Hint. Use the result of Exercise 23 


tec. 10.6 

p 465 


1 X » r, 


3 X - cic- 


■3 + I ‘‘ 


1 1 0 
“”( 1-111 


cos / + ^ sin f 


X - Cl 1 

-lh4-‘s\\ 

c-“ 4- 

|o| + 

X “ cic“' 

' ( I -5 1 2' + 

l-i\ 

sin 2t^ 


+ c,*-( - 

3 

2^ + II , 


g sin 2<^ 


Chapter 11 

tec. 11.1 1 (a) Indefinite, (b) positive-definite, (c) negative-definite, 

p 476 (d) positive-semidefinite 

6 (a) Minimum at (0,-3), (b) critical point at ( — 2,0,0), which 

neither a maximum nor a minimum, (c) maximum at (3,2,.J), 
(d) minimum at (1,0), (-1,0) is a critical point which is neither a 
maximum nor a minimum, (e) minimum at (1,1), (0,0) is a critical 
point which is neither a maximum nor a minimum, (f) minima at 

ilirr *f 2nir, -|- 2 mir), maxima at (*^ir + 2 nir, + 2m7r) and at 

( 5 ^v 4 " 2 nT, + 2 mir) 



ANSWERS TO ODD-NUMKIED EXERCISES 


- W 


sec. 11.2 

p. 491 


»ec. 11.3 

p 503 


9 U, 


1 

V2 


Ur 


1 

y/2 


Ur 


y /~2 


2 

-1 

0 


1 (a) Xi " 1, Xj “ 2 (repeated, with a single independent characteristic 

vector); Xi - I 


4 


3 

1 

.X, - 

1 

-3 


-2 


(b) Xi * 1 (repeated, with two independent charact^^nstic vectors). 


X« “ 2, (JV,)i 


, {X,)r 


0 

-2 

1 


(C) X, = 0, X, = 1, Xa - 2, X ^ - 


(d) X, 

(e) X, 


-1, X 2 


1, X, -4, X, 



2 

.X, - 

1 


2 

1 

1 

C 2 “ 11 “ 

1 , 

11 

2 


, X, 


2 

1 2 


-7 


, Y, - 

Oli 

1 11, X. - 

3 


-ill 

- 1 


1 (repeated, with a single independent rharactenstic vector), 



1 


3 ] 

X 2 = 6, X, - 

I 

,Xr = 

8 


-1 


7 


(f) X| “ 1 (repeated, with two independent characteristic vectors), 



1 


ll 


1 

X 2 “ 6, (Xi)i = 

1 

, (Xi)* - 

0| 

, X: ■= 

1 


0 


11 


1 


3 (a) Xi = 1 (repeated, with two independent characteristic vectors), 


,(;^i). 


\ 

2\/2 


, (^1)3 = - 7- 

6 V2 


-1 

4 

3| 


,X3 = ^ir 2 
II -3 


(b) Xi = 1 (repeated, with two independent characteristic vectors). 


Xj “ 2, (Xi)i “ H 

1 

1 

, (X,)2 = 

1 

-2 

, Xa = H 

-1 

2 


0 


3 


3 


9 If the characteristic equation vanishes identically Example 



1 

2 3 


1 

2 

3 

A - 

2 

3 1 

li = 

1 

1 

1 


1 

1 -1 


1 

1 

1 


16 All characteristic vectors of the symmetric matrix 
proportional to 


-1 


1 

— t 


1 (a) P,Q » 

(b) /^g » 

(C) P,Q » 


1 

0 

II ^ 

— 

2 i 

1 II 

3 

-1 

-3 

1 

’ 11 0 


1 

Ml 

-2 

1 

1 0 

1 

1 1 

II 

1 

0 

IIIM 

1 

0 1 

Ir 

0 1 

II’ 

a 

1 

II' II 1 

1 

1 


0 

0 


1 

1 

-1 

-2 


1 

0 

, 

0 

1 

0 

H 

- 

H 

1 


0 

0 

1 


0 1 
1 0 I 


1 0 
1 1 
H -H 
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1 

0 

0 

1 

0 

-3 

-1 

1 

0 , 

0 

1 

-2 

-2 

3 

1 

0 

0 

1 


1 

0 

0 

1 

0 3 

0 

1 

0 , 

1 

1 -2 

2 

3 

1 

0 

0 1 





l/y/z Z/V? 
1/V3 -I/Ve 

l/y/l l/V?! 

- 2 /-s /6 I/\/ 3 | 

H 3 /\/l 2 
-•5 l/\/l2 


i/Ve 0 -l/\/3. 

I/Ve -'2 '•^v's 

-'i H Iv. 

'4 H }i |y. 

0 1 1 I yi 

1 0 — 1 T/8 

1-1 0 Iw, 

’2 Vs -hV^ 



h V 21 



5 -2 
-2 1 


s-» - H 
H 


1-1 i| 

1 0 3 

0 1-1 

0 1 1 

1 0 1 

1 1 -1 

0 -1 1 


^ L COB « -I- H 


0 -1 - 

S-i » -1 0 

-1 1 

2 3-3 

0 1 1 
0 -1 1 
0 1 1 
S-i -1-1-2 
1 -1 -1 

^ II Bin 2t — M I I COB 21 



3 


3 


3 

• X -'■ yi.i 

3 

COB - - ^^6 

0 

COB i + 

-12 

, 

2 

2 

-10 


2 


+ 3 sin - + Hso 0 sin t + 

2 2 -10 
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StC. 11.4 

p. 515 


6 Yea 


sec. 11.5 

p 524 


9 For all vEJuea of o and 6 , the given equations are satisfied, respectively, 
by the following matrices 


(a) X- 

(c) X = 

16 (a) X, - 

(b) Xi - 


a —b 

a* - 2a - 3 


a —h 

a* — 4a — 6 

-^ 

II ® ^11 X - 
11-1 3II 


X, - 


(0 X 

17 (a) 

(d) 


-4 3 

-2 1 


0 2 
-1 3 


(b) X 


(d) X - 

-1 4|| 

-2 5|| 

h -4 II 
Ii2 oil 

4 -9 11 

6 -nil 

|j -10 9 

"1-65 


o —h 

o* - 4a + 3 


b 

a 

ab 

* 

0 

0 

2a 

0 


2b 

3a 


II ^ 

-2 

X 4 " 

II 1 

2 


X, - 


60 19II 

-57 -leli 


(b) 


(d) Xi 

-3 — 6 II 

9 12 


(c) 


2 -1 
-3 4 5 

3 -3 -4 

0 -6II 

3 9 


-2 - 31 

2 - 71 

1| 


-12 

-27 

-9 


6 

35 

35 

3 

12 

3 

(e) 

3 

76 

73 

9 

9 

6 


-3 

-35 

-32 

.4* - .4 

- 0, 

(b) A*-7 

= 0, 

(c) 

A* — 


(d) A* - 4^ + 3/ - 0 


6 (a) 

(d) 


-A^ 4- 8.4 


35 

A> - 6^^ + 6 5/1 
90 


(b) 


-.4* + 7 A 


(c) 


-.4» + 3A 


(e) 


30 ' 10 

A> - 10^» + 51^1 
210 


sec. 11.6 

p 531 


3 


2e-i _ e-> 2e-' - 2c-* 

-e-i+c"* -c-»+2c-* 

6 By the Cayley-Hamilton theorem, 


( 1 1 2 3 5 8 ,13 , \ 

0+^ 


+ A 

By Sylvester’s identity, 


2 3 5 8^ 13 ^21 

31 4! 51 6' 71 "^8! 


) 


- 2 yfj sinh ^ ^ yjl ^ ^ 

9 The given matrices commute if and only if y - 2x — 1 When the 
matrices commute, 

sin A ^ A sin 1 cos >4-—A-|-/(14- cos I) 

sin 5 - B Bin 1 cos B - / cos 1 


7f2 
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• /. . 3 4- sin 2 , 2 sin 1 — sin 2 

Bin U H- B) - (^ 4- B) - - - I --- 

3 3 

sin (A — B) (A — B) sin 1 

cos (A B) I cos 1 

COB (A — B) - (A — B)(co8 1 ” 1) 4- J 

and, using these, the given identities can easily be verified 


Chopter 12 

s«c. 12.1 

p 543 


1 (a) 3, 9, 13, -18, lOi + 18j + 16k, -548. -H, I3r49', -90. 

245i + 210j - 170k, 220, 0 

(b) 7, 15, 11, 80, 721 + 24) - 12k, -«Ki, 40"22', -636, 

-2101 + 710j + 425k, -1,272, O 

(c) 15, 15, 9, -40, -751 + 60j + 30k. 96°7', 915, 

6101 + lOOj - 1,420k, 1,830, 0 

7 Not necessanly, not necessarily, not necessarily, yes 
9 (171 - 13j + 8k)/^/522 

11 No In fact, if A - 0 and B - C ^ 0. then AXB-BXC« 
CxA-0, butA + B + C-2C^0 

-17A + 14B + 3C -IIU + 319V + 143W 
28 1 + 2j + 3k ------- 


where U 


401 + 45j - 100k 


2i + 27) + 28k 


241 - 6j + 6k 


26 No, because F X R is opposite to the direction in which F would cause a 
right-hand screw to advance 


tec. 12.2 

p. 549 


. , , „ dU d*U 


dU /dU d’D\ /dU d'UN 


7 Yes, the tangents at f — 0 and < * 1 are parallel Yes, for all values of t 
the tangents at t and at — ( are parallel 




i + 2j + 3k 


N - -11* - 8j + 9k 


3 i - 3 j + k 


MC. 12.3 

p. 558 


S (a) y* + 3i* + 2 x 1 — y’; (b) — 2yii + {xy — 2 *)J + (6iy - i*)** 

8 ±!'i(2i - 2j - k) IS n - -3 


MC. 12.4 8 ra'/i 6 (a) 0; (b) -M* 

p 670 7 3 9 iroV24 

11 The common value of the integrals is % 




fee. 12.5 

p. 683 


fee. 12.6 

p 593 


Chapter 13 

sec. 13.2 

p 604 


ANSWERS TO ODD-NUMMRED EXERCISES 


79J 


18 (fc/2)(li* + yj*)("+l)/> _ 

17 Yea, provided the entire boundary is consistently traversed in the posi¬ 
tive sense. 

1, 

JjR\dxdy dy dxj 

I (•) H, (b) (c) (d) m 

8 (a) 1, (b) 6, (c) w/2, (d) t/3 

" -v-^dS 

J Is \ dn dnj 

7 j ^ FU . + F,dy + F , dz - -5)'=““ 

^ /dF. _ /aF, _ j 

\ az ai / \ ai dy / J 


16 0 


r* dR 


6 The length of the curve No, berauae the vector T is defined only on the 
curve C 

XT 

19 The common value of the integrals is 5iraV4 
21 The common value of the integrals is 

28 -27r 

29 If 0 IS a point at winch the surface S has a tangent plane, the integral in 
Gauss’ tlieorem is equal to 2ir If C is a singular point on S, the integral 
may have any value between 0 and 47r 


1 -*rV3; -In r 


9 £ 1 


3 ^ (\/o* + 

a* 


V / 4 nxal 4/ mrai\ rnry 

; ( — cos —— + — -r Bin —— J Bin 
ynir I nV*o I / I 

V / 4 nxat Al . nirfif\ niry 1 

) (-cos--;-TV "T" a* - — 

Li \mr I nV’o ill fit 

n-l ' ' 


+ k 


the summations extending only over the odd positive integers 


(a) 

i - 2j + k . -i - j + 2k 

*■- 3 3 

6* - 

21 + 6j - 4k 
3 


*■ - 21 + k V - 1 + 2j + 3k 

6> - 

1 + j + k 

(b) 

*1 - 21 - J - k - 31 - 2j - k 

fis - 

- 71 + 6j + 3k 

- 1 + 2j - k 6« - 21 + J + 3k 

6» - 

1 + j + k 

(b) 

* \/0’'d-'0 -s/frO-'P 
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sec. 13.3 

p 61S 


sec. 13.4 

p 624 

sec. 13.5 

p 628 


(a) 

(b) 


(d) 

(e) 

(f) 


+ aiiXzyi -I- a2ia-2?/a + 

+ OaiXaJ/i + + agajjjyj 


/(Ji) AXi + f{Xi) Axa -f /(la) 

aiiTiTj 4- anXxXi + aux^x^ (c) 

-f aiiX2Xi 4 aaXtXi 4 ajjiaXa 
4 flaiiai'i 4 a9^XiX2 4 anXaXt 
a\iX\Xi 4 a2ja:2^2 4 OaiXaXa 
(flii' 4 aax* 4 flii*)* = (aix‘)’ 4 (oai*)’ 4 (aax*)* 

4 2aia2i‘x* 4 2aiaax'x“ 4 2a2a3x 

dx^ dy^ dx^ dy^ dx^ dy^ 

dy^ dx^ ' dy- dx^ ^ Sx'‘ 

Sx^ dy'^ dx^ dy^ dx^ dy^ 

4 - - ^2 4 -■-^2 4 - - 22 

dy^ dx^ dy^ dx^ dy^ 5x'‘ 

dx^ dy^ dx® dy"^ 3x® dy^ 

dy^ 3x^ * dy* dx* ^ dx* * 


(g) 


di/> ax* ‘ 

dy^ dx* 


dx* dy* 

4- -z^ 

dy* dx^ 


4 


ax‘ dy* 
dy* ax’ 


2’ 4 


dx* dy* 


dl* dy* 

4- -z^ 

dy* dx* 


4 


_j_ ^ 


dy* dx* 
dx^ ay’ ^ ax* dy* 

ay’ ax* ay® ax* ay* ax* 

(a) At each of the Riven points the lengths of the base vectors are 
e, «» 1, 62 = 2, ea “ 1 

(b) At each of the given points the lengths of the reciprocal base veclorh 
are e’ = 1, c® »= e* = 1 

At (2,0,1), V = -e, + ^ \/3 e. At 

The length of V is 2 




V = e, 4 \/3 e 2 


6 (a) No 


(b) No 


S (a) For a contravanant vector V — ^'c,, the divergence la 
1 r d(r* sin e {’) a(r® sin 6 d(r* am ff 

r® 8111 a |_ ar aa a^ J 

Tf we let F’, F®, F* be the componenta of V along unit vectors in 
the directions of ej, 02 , and e$, respectively, so that F’ ™ f’, 
V* BE F* “ T sm d (*, the divergence appears in the more usual 
form 

1 1 a(8in e V*) ^ 1 aF* 

r* dr r sin 6 d6 r sin 0 d<t> 

(b) For a covorianl vector V — {»e‘, the divergence is 

1 r a(r® sin e ti) a (sin 0 { 2 ) a[(l/Bin g)bl ~l 
r* sin 0 [ ar dd d<tt \ 

If we let Fi, F 2 , Fj be the components of V along unit vectors in the 
directions of e’, e®, and e*, respectively, so that 


F, - 


V, -i’ 


V, - 


r sin 0 

the divergence appears m the more usual form 


1 

r® " dr 


4 • 


1 a(sin a F 2 ) 


r sin 0 


80 


1 aFa 

r sin 0 8^ 
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Chapter 14 

sec. 14.2 

p 635 


sec. 14.3 

p 641 


6 ~ 19 - 22r 

9 ’^(-2+22) 

IB I 1, 2/ - 2, j- = 4, y - 


7 72 

13 1 "f" t, no 


1 


3 


6 


7 


9 


13 


(a) Isolation through —90", (b) r(»tation through 45 ® 

, TT + 2 yJ'l 

4 4 2 

3ir 3^ _ -^2 H- 2 \/2 

4 4 2 

57r 57r — \/2 — j \/2 

4 4 2 

7ir 7n \/2 — l a/- 

C08 — + z sin — =-—— 

4 4 2 


zr r 

COR - -h 2 Sin - 
6 6 

Stt Stt 

cos-1- 7 sin — 

6 6 


+ 2 

2 

2 


Ott Qr 

cos -h 7 Sin -- s= —7 

6 6 

2^'-rcos 15" -I- t sin 15") = 1 084 + 0‘>11? 
2‘^Hcos 135° + 7 sin 135°) = -0 794 + 0 794i 

2h.(coa 255° i sin 255°) = -0 291 - 1 084i 

2'■-(cos 180° 4- f Bin 180°) = -1 320 

2^^(cos 108° 4 7 sin 108°) = -0 408 4 1 255^ 

2^4cos 36° 4- 7 sin 36°) = 1 068 4- 0 776? 

2^ (cos 324° 4- 7 sin 324°) = 1 068 - 0 7767 

2^Hoos 252° 4- T sin 252°) = -0 408 - 1 255t 


At the point 


rn,zi 4- rn^zs 4 7«i-3 

nil 4" 7772 4- 771 j 


sec. 14.4 

p 644 


sec. 14.5 

p. 649 


1 No 

3 If and only if zi and Zz have the same argument (or arguments differing 
by an integral multiple of 2v) 

6 If and only if v = 

7 The j/-axiB, the point (1,0), there is no locus 

9 The act of all points on and within the parabola y* = 2i — 1 

1 -2 - 37 3 -72* 4-22-1 

6 (a) Unbounded, open, simply connected 

(b) Bounded, closed, multiply connected 

(c) Unbounded, open, multiply connected 

(d) Unbounded, closed, simply connected 

(e) Unbounded, neither open nor closed, simply connected 

(f) Bounded, closed, simply connected 

7 Along the parabolic paths y - mj* the function approaches the respec¬ 
tive limits-; hence, lim --—— does not exist 

I 4- 771* ^0 X* + 
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MC. 14.6 

p 656 


sec. 14.7 

p 663 


sec. 14.8 

p 674 


Chopfer 15 

sec. 15.1 

p. 685 


sec. 15.2 

p 691 


1 At * - -1, ±1 

8 Only at the origin; only at the origin, nowhere 

6 If and only if u and v are constant 

7 The values all he on the circle x *» --V * - 7~T~’ i e , the 

1 m* 1 -h m* 

circle x’ + v* “ 1 

7 (1 + i)‘-’ - e<'” v^+*/4+*n.)+.(- In v/2+./4+2n.)^ arguments 

of the different values differ only by multiples of 2ir 

8 1 18 Yes 

16 z -\-t cosh-* 3 17 r - In 2 -f (2n -h l)xz 

19 Since the complex numbers are not ordered, the inequalities appearing 
in Rolle’s theorem are meaningless for complex variables 

28 2 

1 Along each path the integral is equal to 6 -|- 26i/3 
3 Along each path the integral is equal to *^( — 1 + 5i) 

6 On the path \z\ — 3 the absolute value of the integral is dominntetl l)y 

(This 18 a very crude estimate, sinee by the methods of Chaj) IG 
the exact value of the integral can be shown to be sin 2 ) On the path 
\z\ = 3-^ the integral, by Cauchy’s theorem, is 0 

7 (a) 0, (b) >^(3-f2i)7r, (c) H{-3 2i)x 

9 (a) -3i7r/2, (b) 3it/2; (c) 0 


1 The interior of the circle of radius 1 and center i 
3 The parabola y* =» — 1 — 2x and its interior 

9 Yes, for instance, for all values of x, the senes of continuous fundinnH 


X 

1 

X 2x 

+ 

2j 

1 + X* 

I -h x> 1 + (2x)*_ 

_i +“( 2 ^ ~ rr 


converges to the continuous function 0, although in the neighbvirhood of 
the ongin the series does not converge uniformly In fact, |/?n(x)| 

- — - < e implies that n must satisfy a requirement of the form 

1 -}- (nx)* 

n >/(0/|x! 


1 (a) f{z) - -1 H- 2z - 2z» + 2z» - 

.u^ ^ ^ - 1 (^ - D* . - D’ 

(b) f(z) - —--—--+ —-- 


Ul < 1 
U - i)‘ 
16 


+ 


|r - II 


Ul < 1 


« (•) /(O - - - Hi' + Ul' - 'Hu* + 

C \/2 T 2 \/2 


_ 2 | < 3 




sac. 15.3 

p. 697 


Chapter 16 

sec. 16.1 

p 703 


sec. 16.2 

p 709 
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1 (a) ](z) = + Hz' + ‘Hb** + • • • 

rt,) /(,).- . 

z* * 2 4 8 16 

IK 'J *3 -I 

(c) m - . ■ 

I 


Z* z* z* 


(d) fU) - - 

(e) f{z) - - 

(0 /(2) 

(g) /(z) 


2—1 


1 - (z - 1) - (z - 1)« - 


1 


z - 2 
= • — + 

1 


I 1 1 

(z - D* (z - !)• ^ D* 

- 1 + (z - 2) - (z - 2)» + (z - 2)« - 
1 1 1 


(z - 2)* (z - 2)=- ‘ (z - 2)* 

8 /(z) — — --- — 2t + 3(z — i) 4- 4i(z - i)® — 5(z — i)* — 

0 <: Iz - t| <1 


/(z) 


2t 


+ 7 


1 


Iz - i| > I 


(, t). (2 _ 1). _ 1)3 

6 (•) 0, (b) 2iri; (c) 0, (d) 0, (e) 27ri, (f) i7r/6 

7 The argument ib invalid lr>ccause there is no value of z for which both 
series converge, that is, there is no value of z for which the two senes are 
simultaneously valid 

1 r2r 

9 (c) On = -- cosh (2 ros B) cos nd dd 

1 f2w 

(d) a« =" — / cos (2 cos (?) cos nd dB 
2ir yo 


1 (a) 4, (b) 

8 At z = -1 4- 2i the residue is ’ i(2 4- t), at z = -1 - 27 the residue is 
'^(2 - x) 

6 -1 7 3^0 

0 (a) 27 ri, (b) 0; ''c) 0, (d) 0; (e) 0, 

(f) Hi5+2\/l)tw 


2w 


6 

0* 

e ir/3 

18 TT cos ma P-"V6 


8 TT 

7 


\/2 a* 

11 7r/4a* 

16 7r(l 4- am)e~*^^lia* 
19 XC-/V- ^ 


ir 

ar:rr\l, -^7) 

21 —^— I (b* 4- sin j^(a - 1) tan“^ ^]} 

(i+2cob^) 


3 siu air ' 



799 


ANSWERS TO ODD-NUMBERED EXERCISES 


Bee. 16.3 

p. 716 


sec. 16.4 

p 728 


Chapter 17 

sec. 17.1 

p. 732 


sec. 17.2 

p. 737 


sec. 17.3 

p. 747 


29 


(-])"2 
\/a’ - 6 > 




As n —> «, a» approaches zero more rapidly than the reciprocal of any 
fixed power of n This is, of course, implied by Theorem 3, Sec 6 3 
since all derivatives of the given function are everywhere continuous 


1 8 sin 21 

6 1 — cos t 7 f sm (2f/4) 

9 6-«(2 - t) - 2c-" 


11 SM 


To SI Y sin [(2n -|- l)rx/2l] cos [(271 -f l)Trat/2lj 

n -0 


18 fit) - 1 + 




(— I)"'*'* nirt 

-sin — 

n 2a 


15 /(/) 



2Jo(\jr)e-\ ^ 


where is the jth root of the equation Jo(X) 


0 . 


1 D\ “ 0, Z^2 “= —9, Di = —81; therefore, there is at least one root with 
nonnegative real part. (Actually the roots are — 1 92, 0 86 ± 1 94? ) 

3 Di =» 2, Dj = 10, Da — 0, D4 » 0, therefore, there is at least one root 
w'lth nonnegative real part. (Actually the roots are ± t 2, — 1 ± 2i ) 


8 The transformation w » f{2) is equivalent to the transformation w = 
f(z) follow^ed by a reflection in the real axis 

6 Angles are not preserved 

7 The equations of the transformation are 

u ^ X* — 6a:*y* + y* t; - 42*j/ — ixy^ 

The image of x — 1 is 

V* - 22Auv^ - 256u» - 2,l76y» - l,792u* - 2,084u 4 4,096 - 0 

9 The equations of the transformation are 

1 _ y _ ^ 

4 l/» " X* 4 

1 (a) T/a; (b) „/y/2 
3 (a) z- ±\, (b) |z* - 1| - 

(c) X* - 2xy - y* - 1, (d) J* - - I 

0 The images of the perpendicular lines x — 1 and 1/ »■ 0 intersect at an 
angle of 45*’. 

1 -1 

8 If (d — ay 4 46c - 0, the transformation leaves a single point invariant 

At least one point must be left invariant by any bilinear transformation. 
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lec. 17.4 

p 753 


Appendix 

p 704 


6 w 


iz — 2 
2+2’ 


3(«» + v») + 8m + 2v + 3 


0 


7 

9 w 

17 r 


- f where a, b, c, d are all real and ad — 5c < 0 

cz 4 d 


- i 
2^ +2 


11 IV 



100 ^ - y* 

— Ian*-- 


X® — 3x1/“ 


19 T 


100 1 — X® — v’ 

tan *- 

T 2y 


1 m; = 3iP“\/z 6w> = Vz®“l 

7 In the half plane onto which the given region la mapped by the mapping 
function w = y/ z^ — 1 + cosh"* z, the leniperature ib 


1 2x2/ 

T - -tan-‘-- \ - 

IT X* — 7/* — i 

This cannot he explicitly tranaformed bjirk into an cxpicsaion for the 
temperature in the original region in the le-planc 

c 4 1 
1 


iir 4 In 


1 n = 3 320, /2,ra = 1 33H + 0 6321 

3 r, = 3 732, fz = -2 6IS, r^ = -0 382, r 4 = 0 268 

6 r, = J 107, Ti = - 0 838, /, ^ ^ * 0 500, rj = -0 270 

7 n = 4 060, fi ~ 2 450, r„7 4 = 0 612 ± 1 120t, = -0 640 
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The letter e after a paf;e number refeis to an exercise, the letter w to a footnote 


Abel’s identity, 32 
Abscissa of convergence, 226 
Absolute convergence, of infinite senes, 677 
of Laplace transforms, 229 
of senes of matrices, rj27 
Absolute value, of complex number, 641 
of vector, 4" ' 532 
Acceleration, normal, 548 
tangential, 548 
vector, 548 

Acceleration smoothing, 135, 142f 
Addition, of complex numbers, 633 
of determinants, 408 
of infinite senes, 678 
of matrices, 418 
of vectors, 533 
Adjoint matrix, 430 
Admittance, 169 
mdicial, 273 
Admittance matrix, 417 
Advancing differences, 82 
Ampere’s law, 589 
Amplitude, of complex number, 637 
of forced vibrations, 155-157, 329 
of free vibrations, 306, 307 
of nth harmonic, 197 
Amplitude envelope, 153, 162 
Amplitude modulation, 162, 165f 
Amplitude spectrum, 213, 214 
Analytic functions, 653 
derivatives of 653 
line integrals of, 667, 670 
mapping by, 732 
poles of, 699 
principal part at, 699 
properties of, 654, 655 
residues of, 700 


Analytic functions, residues of, practical 
computation of, 702 
senes of, 683, 684 
singulsr points of, 653, 699 
Anharmonic ratio, 741 
Annulus, 646 
Antidifference, 87 
use m summing senes, 88 
Argand diagram, 636 
Argument, of complex' number, 637 
principal, 661 
principle of, 722 
Augmented matrix, 447 
Auxiliary equation, 38 

Beams, bending of^ 56 
bending moment on, 56 
deflection curve of, 56 
end conditions for, 323, 327c 
free vibration of, 287, 323 
load per unit length on, 56, 288 
neutral axis of cross section of, 56 
neutral surface of, 56 
shear on, 56 
Beats, 162 

Ber and bei functions, 365 
Bernoulli numbers, 102 
Bernoulli’s equation, 21c 
Bessel functions, asymptotic formulas for, 
357e. 

behavior of, at origin, 356, 359 
differentiation of, 365, 366 
equations solvable in terms of, 363 
expansions in senes of, 375, 380, 385 
of first kind, 353 
modified, 358 
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Bessel functions, of first kind, modified, 
asymptotic formulae for, 363e 
generating function for, 369 
mtegral formulas for, 371 
integration of, 368, 372^ 

Laplace transforms of, 377, 386c 
of order ±yi, 364 
orthogonality of, 374 
recurrence relations for, 367 
of second kmd, 354 
modified, 358 
of third kind, 354 
zeros of, 356, 359 

Bessers equation, equations reducible to, 
363 

modified, 357 
of order n, 351 

with a parameter, 351 
senes solution of, 351 
Bessel’s inequality, 32Kc 
Bilinear form, 469 
Bilinear transformation, 737 
Binomial coefficients, 83n 
Binomial expansion, 695 
Binomial, 550e 
Boundary point, 64G 

Boundary-value problems, summary of, 326 


Cantilever beam, end conditions for, 323 
vibration of, 323 
Casoratti’s determinant, 119n 
Cauchy-Ooursat theorem, 66S 
Cauchy-Ricmann equations, 652 
Cauchy’s equation, 61 n 
Cauchy’s inequality, 544c , 644e 
for 673 

Cauchy’s integral formula, 669 
extensions of, 672 
Cauchy’s theorem, 667 
Cayley-Hamilton theorem, 517 
Center of gravity, 549 
Central differences, 82 
Channel, flow out of, 752 
Characteristic curves, 301e 
Characteristic equation, of boundary-value 
problem, 326 

of difference equation, 120 
of differential equation, 38, 52 
of matne equation, 477, 487 
of system of differential equations, 75, 462 
Characteristic functions, 326 
orthogonality of, 320, 322 
Characteristic polynomial, 477 
Characteristic root, regular, 481 
Characteristic-value problem, for matrices, 
477, 487 

for partial.^differential equations, 461 


Characteristic values, 326, 477 
Characteristic vectors, 477 
orthogonality of, 484, 489 
Characteristics, method of, 295n , 30le 
Christoff el symbols, of first kind, 629 
of second kmd, 629 
Circle of convergence, 688 

use of, with senes of real terms, 690 
Closed formula, 110 
Closed-loop system, 727 
Closed set, 646 
Closure, 318 

Coefficient of correlation, I43e 
Cofactors, 401 
Columns, buckling of, 57 
critical loads for, 58 
Complementary functions, of diffeience 
equations, 119 
table of, 121 

of differential equations, 35 
table of, 40 

of systems of differential equations, 70, 
462 

Complete holution, of difference equatioRis, 
119 

of differential equation, 5, 42 
of systems of algebraic equations, 448 
of systems of differential equations, 70, 70 
Completeness, 317 
Complex impedance, 169 
Complex inversion integral, 225, 711 
Complex number, 633 

alisolute value of, 637, 641 
amplitude of, 637 
argument of, 637 
principal, 661 
components of, 634 
conjugate of, 634 
exponential form of, 658 
imaginary part of, 634 
logarithm of, 661 
modulus of, 637 
negative of, 634 
polar form of, 637 
powers of, 639, 661 
real part of, 634 
roots of, 639 

trigonometric form of, 637 
Complex numbers, addition of, 634 
division of, 634 
m polar form, 638 
equality of, 634 

geometrical representation of, 636 
inequalities for absolute values of, 641 
multiplication of, 634 
in polar form, 638 
subtraction of, 634 
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Complex plane, 636 
integration in, 663”665 
Complex variable, 644 
analytic function of, 653 
exponential function of, 056 
function of, 644 
continuity of, 64S 
geometrical representation of, 729 
regular point of, 653 
singular pomt of, 653, 699 
hyperbolic functions of, 660 
mverse, 662 

logarithmic function of, 660 
trigonometric functions of, 659 
inverse, 662 
Conductance, 169 
Conformal mapping, 722 
behavior, of angles under, 735 
of infinitesimal areas under, 734 
of infinitesimal lengths under, 734 
critical points of, 733 
Congruence transformation, 443 
Conjugate complex numbers, 634 
Conner ted set, 646 
Conservative held, 5S6 
Continuity equation ol, 293, 555 
of function of complex vanalile, 64H 
of sum of mfip'^e scries, 682 
Contour integral, o64 
Contravanant t('nsor, 620 
covariant derivative of, 631 
Contravanant vector, 603, 620 
Convergence, abscissa of, 226 
absolute, of inhnite senes, 677 

of Laplace transform integral, 229 
of senes of mal rices, 527 
circle of, 688 
conditional, 677 
of Fourier senes. 194 
of improper integrals, 228 
of infinite senes, 676 
ratio test for, 677 
of Laplace transforms, 229, 231 
m the mean, 318 
radius of, 689 
of senes of matrices, 526 
uniform, 678 

of Laplace transform integral, 231 
Weierstrass M test for, 681 
Convergence factor, 224 
Convolution integral, 271 
Coordinates, cylindrical, 566 
generalized, 605 
normal, 503 
oblique, 597 
spherical, 389 
Corrector formula, 110 
Cosme transform, 236 


Covanant tensor, 620 

covariant derivative of, 631 
Co variant vector, 603, 620 
Cramer’s rule, 453 
Critical damping, 152 
Critical pomts of conformal transforma¬ 
tions, 733 

behavior of angles at, 734 
Cross product, 531 
Cross ratio, 741 
invariance of, 741 
Crosscuts, 647 
Curl, 554, 556 
formulas for, 556 
in generalized coordinates, 627 
Curvature, 548 
radius of, 548 

('urve fill mg, by factorial polynomials, 86 
by harmonic analysis, 206 
hy Lagrange’s formula, 94 
l>y least squares, 135, 142e 
hy Newton’s dividcd-dilTerenco formula, 
91 

hy oithogonai polynomials, 133 
C’urvc smoothing, 135 
Curves, sectionally smooth. 559 
simple closed, 568?? 

C’ylmdrical cooidinatcs, 56 


/), 36 

D’Alembert’s solution of wave equjition, 295 
Damped oscillation, 153 
Damping, cntical, 152 
VISCOUS, 147 
Damping ratio, 157 

relation of, to logaiithmic dei'ieinent, 155 
Decibels, 155n 

r^efinite mtegials, for Bessel functions, 371 
differentiation of, 274n 
evaluation of, by gamma functions, 239 
by residues, 704 

improper (see Improper integrals) 
Deformation of contours, principle of, 668 
Degrees of freedom, 145 
V, 552 
V>, 588 
A, 81 
6, 82 

6-function, 276 
de Moivre’s theorem, 639 
Dependence, Imear, 444 
Determinants, addition theorem for, 408 
definition of, 403 
diagonal dominance in, 455?? 
differentiation of, 414e. 
double subscript notation for, 401 
elements of, 401 
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Determinants, elements of, cofactors of, 
401 

minors of, 401 
expansion of, Laplace’s, 406 
by oofaotors, 403 
Gramian, 460c 
Jacobian, 609 
mth-order minors of, 401 

algebraic complements of, 401 
complementary, 401 
multiplication of, 411 
properties of, 407-411 
Difference equations, 118 
characteristic equation of, 120 
complementary functions of, 119 
table of, 121 

complete solution of, 119 
homogeneous, 118 
nonhomogeneous, 118 
order of, 118 

particular solutions of, 121 
table of, 122 
solution of, 118 
use of, m least squares, 143e 
m summing senes, 122 
Difference operators, 81 
Difference table, 80 
Differences, advancing, 82 
central, 82 
divided, 80 

Differential, exact, condition for, 

583 

total, 552 

Differential equation, 1 
Bernoulli's, 21c 
Bessel’s, 351 
modified, 357 
Cauchy’s, 6 In 
Euler’s, 61 

having a given general solution, 6 
of heat flow, 290 
Hermite's, 399e 
Daguerre’s, 399c 
Laplace’s, 291 

in cylindrical coordinates, 294c , 382 
in generalized coordinates, 627 
m spherical coordinates, 389 
Legendre's, 391 
associated, 390 

linear (see Lmear differential equations) 
nonlinear, 2 
order of, 2 
ordinary, 2 
partial, 2 
Poisson's, 588 
solution of, 1 
complete, 5 
general,^ 5 


Differential equation, solution of, singular 
6 

of vibratmg beam, 288 
of vibrating membrane, 285 
of vibrating shaft, 287 
of vibratmg string, 284 
Differential equations, Cauchy-Riemann, 
652 

of electrical circuits, 150 
first-order, exact, 14 
existence theorem for, 5 
homogeneous, 11 
linear, 19 
separable, 8 
of higher order, 52 
Maxwell’s, 691 
of mechanical systems, 150 
numerical solution of, 108 

Adams-Bashforth method, 116c 
Adams-Moulton method, 117c 
Euler’s method, 112 
Kutta’s third-order approximation, 112 
Milne’s method, 108 
modified Euler method, 112 
Runge-Kutta method, 114 
Runge’s method, 112 
of second order, homogeneous, 30 
nonhomogeneous, 30 
series solution of, 347 
simultaneous {see Simultaneous differ¬ 
ential equations) 

solvable in terms of Bessel functions, 36.1 
of transmission line, 292 
Differentiation, of analytic function, 653 
of Bessel functions, 365, 366, 372c 
of definite integral, 274n 
of determinants, 414c 
of Fourier senes, 195 
of improper integrals, 229 
of infinite senes, 684, 685 
of Laplace transforms, 251 
of matrices, 428c 
numerical, 99, 136 
of vector functions, 545 
Dimension of set of vectors, 456 
Directional derivative, 551 
Dinchlet conditions, 185 
Dinchlet’s theorem, 185 
Distributions, theory of, 278n. 

Divergence, 554 
formulas for, 556 
m generalized coordinates, 624 
Divergence theorem, 572-574 
Divided differences, 80, 90c. 

Domain, 646 
Dot product, 418, 534 
Doublet function, 277 
Duhamel’s formulas, 274 
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Pummy index, 610 
Dyewi, 535n. 


B, 82 

Eigenfunction, 326 
Eigenvalue, 326 
Eigenvector, 478n 

Einstein summation convention, 6)0 
Elastance, 165 
Elasticity matrix, 435 
Electrical circuits, differential equations of, 
150 

forced vibrations of, 167 
free vibrations of, 166, 174 
laws of, 148, 149 
Electrostatic field, 585 

Elementary functions of complex variables, 
656 

Energy method, 59 
Equivalence transformation, 443 
Equivalent equations, 449n 
Equivalent matrices, 438 
Error function, 343 
Error signal, 727 
Essential singularity, 699 
Kuler-Maclaurin summation formula, 101 
Euler’s equation, I 

Euler's formulas, for cos $ and sin 6, 659 
for Fourier coefficients, 182 
Euler’s theorem on homogeneous functions, 
14e 

Even function, 189 
Fourier expansion of, 190 
Fourier integral of, 217 
Exact differential equation, 15 
Exponential function, 189 
Exponential order, 226 
Exterior point, 646 

Factorial polynomials, 84 
expansions m terms of, 85 
Foiling bodies, 27e. 

Faltung integral, 271 
Faraday's law, 689 
Feedback loop, 726 
Feedback signal, 727 
Field, conservative, 586 
electrostatic, 585 
gravitational, 585 
magnetic, 585 
Field intensity, 586 
Finite differences, 79 
First-order reaction, 26 
Forced motion, 151 


Forced vibrationa, of electric circuita, 68 
of maaa-spring aystema, 156, 161, 407 
magnification ratio for, 157 
phase angle for, 158 
Fourier integrala, 211 

approximation by, when upper limit is 
finite, 219 

for even functions, 217 
exponential form of, 215 
initial conditions fitted by, 332 
as limit of Fourier series, 211 
for odd functions, 217 
relation to Laplace transforms, 222 
transform-pair roruia of, 215, 217 
trigonometric form of, 216 
Fourier series, 181 

alternative forms of, 196 
amplitude spectium of, 213, 214 
coefficients of, 184 

behavior of, for large n, 194 
complex form of, 197 
convergence of, 194 
differentiation of, 195 
half-range, 192 

of oven functions, 190, 196c 
of odd functions, 191, 196c 
initial conditions fitted by, 306, 308, 309 
integration of, 195 
nth harmonic of, 197 
periodic excitations represented by, 201, 
204 

plots of partial sums of, 187 
Fourier transform pair, for even function, 
217 

for odd function, 217 
uiidateral, 222 

Fourier transforms, 22le , 222c 
Fourier’s law of heat conduction, 27c 
Free motion, 151 
critically damped, 152 
overdamped, 151 
underdamped, 153 

Free vibrations, amplitude of, 306, 308, 328 
of beams, 287, 323 
of electric circuits, 166, 174 
cf maSB-sprmg systems, 151 
of shafts, 302 
of strings, 298, 379 
Frequency, effect of friction on, 164 
natural, of cantilever beams, 324 
of LC circuits, 166, 174 
of mass-spring systems, 154, 499 
of shafts, 306, 308, 309 
of strings, 299, 31Qe. 

Frequency equation, 326 
determinantal, 499 
Frequency ratio, 157 
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Friction, coefficient of, 164e. 

Coulomb, 164c 

effect of, on frequency, 164 

viscous, 146 

Frobemus, method of, 347 
Function, S, 276 
entire, 691 
error, 343 
even, 189 
exponential, 657 
filter, 248 
gamma, 238 

generalized factorial, 238 
harmonic, 654 
holomorphic, 653 
homogeneous, 12 
impulse, 276 
integral, 691 

logarithmic, of complex variable, 660 
principal value of, 661 
Morse dot, 266 
odd, 190 
penodic, 182n, 
potential, 586 
rms value of, 200 
Bine integral, 218 
staircase, 262 
transfer, 273, 727 
unit doublet, 277 
unit step, 237 

Functions, analytic (sec Analytic functions) 
ber and bei, 365 
Bessel (see Bessel functions) 
characteristic, 326 
complementary (sec Complementary 
functions) 

conjugate harmonic, 654, 656e 
elementary, of complex variables, 656 
of exponential order, 226 
Hankel, 354 

hyperbolic, of complex variables, 660 
inverse, 662 
ker and kei, 362 
Legendre, of second kind, 391 
orthogonal (see Orthogonal functions) 
orthonormal, 315 
regular, 653 
piecewise, 226 
smgularity, 277, 280e 
translated and “cut off,” 247 
trigonometric, of complex variables, 659 
mverse, 662 

vector (see Vector functions) 
Fundamental metric tensor, 621 


Gamma function, 238 
graph of, 239 


Gauss’ law, for electric fields, 589 
for magnetic fields, 589 
Gauss’ reduction, 449 
Gauss' theorem, 577, 585e, 

Generalized coordinates, 605 
curl in, 027 

differential of arc in, 606 
divergence in, 627 
Laplacian in, 626 
length of vector in, 607 
local base vectors m, 606 
local reciprocal base vectors in, 606 
parametric curves m, 605 
transformations of, 609 
Generalized functions, 278 
Generalized orthogonality, 470 
Generating function, for Bessel functions, 
370 

for Legendre polynomials, 394 
Gradient, 651 

geometrical properties of, 551, 552 
Graeffe’s root-squanng process, 755 
Gram determinant, 460e. 

Gramian, 460e 
Gravitational field, 585 
Gravitational potential, 588 
Green's lemma, 567-570 
Green’s theorem, 575 
Gregory-Newton formula, backward, 95 
forward, 94 

Gregory's formula of numerical integration, 
104 

Half-range Fourier senes, 189 
Hankel functions, 354 
Harmonic analysis, 206 
Harmonic functions, 654 
conjugate, 654, 656e 
Harmonics, 197 
higher, resonance with, 202 
spherical, 389 
surface, 390 
zonal, 392 
Heat equation, 290 
solution of, 311, 333, 382, 397 
uniqueness of solutions of, 593 
Heat flow, in cooling fins, 381, 387e 
in cylmders, 382 
differential equation of, 290 
uniqueness of solutions of, 593, 594e 
laws of, 27e., 288, 312 
m spheres, 397 
in thin rods, 311, 331 
in thm sheets, 333, 744 
Heaviside’s expansion theorems, 255 
Hermite polynomials, 399e. 

Hermite’s equation, 399e. 



Hermitian form, 469 
Holomorphic function, 653 
HomogeneouB differential equations, first- 
order, 11 

higher-order, 30, 52 
simultaneous, 74, 461 
Homogeneous functions, 12 
Euler’s theorem on, 14^ 

Hyperbolic functions of complex variables, 
660, 662 


Impedance, electrical, 167 
complex, 169 

parallel combmations of, 169 
senes combinations of, 169 
mechanical, 167 

Improper integrals, continuity of, 228 
convergence of, 228 
differentiation of, 229 
mtegration of, 229 
principal value of, 706n 
Impulse function, 276 
Inconsistent equations, 450 
Independence, linear, 444 
Indicial admittance, 273 
Indicial equation, 348 
Inequalit Cauchy's, 644c , 644c. 
for 673 

for complex numbers, 641 
for line mtegrals, 665 
Infinite senes (see Series) 

Inner product, of tensors, 622 
of vectors, 418, 534 
Integral, complex inversion, 225, 711 
contour, 664 
convolution, 271 
of Joix), 369n., 371«, 
running, 105 
surface, 565 
volume, 566 

(See also Definite integrals, Fourier in¬ 
tegrals, Improper mtegrals, Line 
integrals. Particular mtegrals) 
Integrating factor, 17, 20 
Integration, of Bessel functions, 368, 372c 
of Fourier senes, 195 
of improper integrals, 229 
of mfinite series, 683 
of Laplace transforms, 252 
line, 560 

in complex plane, 664 
numenoal, 104 

of differential equations, 108, 116c., 
117c 

Integrodifferential equation, 148 
Interior pomt, 646 


Interpolation formulas, Gregory-Newton, 
backward, 95 
forward, 94 
Lagrange’s, 94 
Laplace-Everett, 97 
Newton-Gauss, backward, 97 
forward, 96 

Newton’s divided difference, 91 
Stirling's, 97 
Inversion, 738 


Jeix), integral of, 369n., 371c. 
Jacobian, 609 

of conformal transformation, 733 
Jacobian determinant, 609 
Jacobian matrix, 609 
Jordan canonical form, 497 


Ker and Kei functions, 362 
Kernel of transform, 236 
Kirchhoff’s first law, 149 
Kirchhoff’s second law, 148 


£, 227 
£-S 227 

Lagrange’s identity, 643 
Lagrange’s interpolation formula. 94 
Lagrange’s reduction, 470 
Laguerre polynomials, 399c 
Laguerre’s equation, 399c 
Lambert's law, 25c 

Laplace-Everett interpolation formu a, 97 

Laplace transform pair, 225 

Laplace transforms, of Bessel functions, 

377, 386e 

convergence of, absolute, 229 
uniform, 231 
of derivatives, 234 
differentiation of, 251 
of elementary functions, 237 
Heaviside’s theorems on, 255 
of integrals, 234 
mtegration of, 252 
mversion integral for, 225, 711 
limit theorems for, 242, 243, 254c. 
of periodic functions, 260 
tables for, 266, 267 
products of, 270 
of products contaming c““‘, 245 
relation to Fourier mtegrals, 227 
of smgulanty functions, 278, 280e 
solution, of differential equations by, 235 
of partial differential equations by, 338 
of translated functions, 248 




Laplace’s equation, 291 
in cylindrical coordinates, 294e., 382 
in generalised coordinates, 626 
invariance under conformal transforma¬ 
tion, 735 

relation to analytic functions, 654, 669 
in sphi^ical coordinates, 389 
Laurent's ezpanskm, 692 
uniqueness of, 695 
Least squares, 126 
acceleration smoothing by, 136 
curve smoothing by, 135, 142e 
dangers m logarithmic transformationa 
m, 139 

relation to orthogonal functions, 131 
use in, of diflference equations, 143e. 
of orthogonal polynomials, 130 
of Taylor series, 137 
velocity smoothmg by, 135, 142e. 
Legendre functions, 391 
Legendre polynomials, 388 
algebraic form of, 392 
generating function for, 394 
orthogonality of, 397, 399e 
Rodrigues’ formula for, 392 
senes of, 398 

tngonometric form of, 395 
Legendre's equation, 391 
associated, 390 
algebraic form of, 391 
Leibnitz’ rule, 274n 
Lerch's theorem, 244n. 

Lever surface, 552 

Limit of function of complex variable, 648 
Limit pomt, 646 

Lme integrals, m complex plane, 664 
conditions for mdependence of path, 
679-582 

inequalities for, 665 
real, 560 

geometrical mterpretation of, 602 
of vector functions, 560 
Lmear combination, 445 
Lmear dependence, 444 
Lmear differential equations, 2 
complementary function of, 35 
complete solution of, 33 
with constant coefficients, 35 
auxiliary equation of, 38 
characteristic equation of, 38 
higher order, 30, 52 
homogeneous, 30, 36 
nonhomogeneous, 30, 42 
particular mtegrals of, by Laplace 
transforms, 272 
exponents of, 348 
finding second solution of, 33 
first-order, 19 


Lmear differential equations, indirial 
tkm of, 348 
ordinary point of, 345 
particular integral of, 35 
by variation of parameters, 49 
series solution of, 347 
singular pomt of, 345 
irregular, 346 
regular, 346 

Lmear equations, systems of, 447 
augmented matrix of, 447 
coefficient matrix of, 447 
complete solution of, 448 
equivalent, 449«. 

Gauas reduction for, 449 
homogeneous, 447 
inconsistent, 450 
nonhomogeneous, 447 
trivial solution of, 454 
Linear fractional transformation, 737 
Linear mdependence, 444 
Lmear transformation, 425 
matrix of, 425 
Liouville’s theorem, 691 
Load per unit length, 56, 288 
relation to shear, 67 
Logarithmic decrement, 15^. 

relation to damping ratio, 155 
Logarithmic function^^O 
prmcipal value of, 661 
Lumped parameters, 145 

M test, 681 
Magnetic field, 585 
Magnification ratio, 157 
Mapping, 729 
conformal, 732 
isogonal, 735 

Matnc differential equations, 461 
Matnc equations, 447 
characteristic equation of, 477, 487 
characteristic values of, 477, 487 
reality of, 482 

characteristic vectors of, 477, 487 
independence of, 484, 486, 490 
normalized, 491 
orthogonality of, 484, 489 
solution of, 513 
Matnees, addition of, 418 
conformable, 419 
conformably partitioned, 424 
diagonal!zation of, 493, 495 
elementary transformations of, 437 
equal, 416 

equivalent to diagonal matrix, 493 
multiplication of, 420, 422 
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MatriceSj senes of, 525 
similar, 443 

characteristic polynomials of, 479 
similar to diagonal matrix, 495 
subtraction of, 418 
transformations of, 492 
congruence, 443 
equivalence, 443 
orthogonal, 443 
similarity, 443 
unitary, 443 

transpose of products of, 423 
Matrix, 415 
adjoint of, 430 
admittance, 417 
associate of, 416 
augmented, 447 
characteristic equation of, 477 
characteristic polynomial of, 477 
characteristic values of, 477 
multiple, 481 
reality of, 481 
regular, 481 

characteristic vectors of, 477 
independence of, 480, 484 
orthogonality of, 484 
coefficient, ^147 
column, 41w 
conjugate of, 416 
derivative of, 428c 
diagonal, 415 
elasticity, 435 
Herniitian, 416 
imaginary, 416 
inverse of, 430 
Jacobian, 609n. 
lowei triangular, 415 
minimum polynomial of, 521 
minors of, 416 
principal, 416 
modal, 487 
nonsingular, 429 
nth power of, 506 
null, 416 
orthogonal, 435 
rank of, 437 
column, 456 
determinant, 437 
row, 466 

Sylvester's law of nullity for, 457 
real, 416 
row, 415 
scalar, 428c 
singular, 429 
skew-Hermitian, 416 
skew-symmetric, 416 
square, 416 
determinant of, 416 


Matrix, square, functions of, 505 
square roots of, 514 
trace of, 479 
{See also Square matrix) 
stiffness, 434 
symmetric, 416 
transpose of, 415 
unit, 416 
unitary, 435 
zero, 416 

Maxima and minima of functions of several 
variables. 474 
Maxwell’s equations, 591 
Mechanical impedance, 167 
Milne’s method, 108 
Minimum polynomial, 521 
Minors, 401, 416 
Mdhius transformation, 737 
Modal matrix, 487 

Modified Bessel functions, of first kmd, 358 
of second kmd, 358 
Modulus, of complex number, 637 
of elasticity, 294 
of spring, 59 
Moment, bending, 56 
of force about a point, 545c 
vector, 545c 

Motion, critically damped, 152 
forced, 151 
free, 151 

overdamped, 151 
steady-state, 160 
transient, 159 
underdamped, 153 
Multiply-connected set, 646 


Natural frequency, 154 
Neighborhood, 646 
Nepers. 155 
Neutral axis, 56 
Neutral surface, 56 

Newton-Gauss interpolation formula, back¬ 
ward, 97 
forward, 96 

Newton's divided-difference formula, 91 
remainder term in, 92 
Newton’s law of cooling, 27c 
Newton's second law of motion, 27c , 146 
m torsional form, 26c , 146 
Normal acceleration, 548 
Normal coordinates, 603 
Normal equations, 129 
Normal modes, 326, 501 
Null function, 316 

Numerical methods, of differentiation, 99, 
136 

of harmonic analysis, 206 




Numerical methods, of integration, 103, 
107€ 

of solving differential equations, 108 
of solving equations, 314, 324, 735 
Nyquist stability criterion, 726 

Oblique coordinates, 597 

metrical properties of space m, 598, 601 
reciprocal base vectors in, 599 
reference vectors in, 597 
length of, 599 
Odd function, 190 

Fourier expansion of, 191 
Fourier integral for, 217 
Ohm’s law, 167 
Open formula, 110 
Open-loop system, 726 
Open set, 646 

Operational calculus (nff Laplace trans¬ 
forms) 

Operators, D, 36 
V, 552 
V®, 291, 558 
A, 81 
6, 82 
E, 82 

equivalent, 83 
£, 227 
£-\ 227 

Order, of difference equation, 188 
of differential equation, 2 
Ordinary point, 345 
Orthogonal functions, 315 
closure of, 318 
completeness of, 317 
expansions in senes of, 316 
least-square approximation by, 328e 
Orthogonal polynomials, 130 
use of, in least squares, 131 

in smoothing of data, 135, 142f 
Orthogonal trajectories, 28c , 655 
Orthogonal transformations, 443 
Orthogonal vectors, 419, 470, 534 
Orthogonality with respect to, symmetric 
matrix, 470 
weight function, 316 
Orthonornial functions, 315 
Orthonormal vectors, 458 
Osculating plane, 548, 550c 

Partial differential equations, 2, 283 
elliptic, 301c 
hyperbolic, 301c 
parabolic, 301c 

solution of, by D’Alembert method, 294 
by Laplace transforms, 338 
by sepsx&f'ion of variables, 302 


Particular integrals, 35 

by Laplace transforms, 272 
for simultaneous differential equations 
76, 465 

by undetermined coefficients, 43 
table of, 46 

by variation of parameters, 49 
Period, 18271. 

Periodic function, ]82u 
Phase angle, 158 
Poisson’s equation, 688 
Poisson’s formula, 675c 
Polar, 470 
Pole, 699 
order of, 699 

principal part of f(z) at, 699 
Polynomials, factorial, 84 
finding zeros of, 755 
interpolation, 91, 94 
orthogonal, 130 
Potential, 586 
gravitational, 588 
Predictor formula, 110 
Principle of argument, 722 
Probabilit> integral, 343n 
Products, of complex numbers, 634, 638 
cross, 534 

of determinants, 411 
dot, 418, 534 
inner, 418 

of Laplace transforms, 270 
of matrices, 420, 422 
scalar, 418, 534 
scalar triple, 538 
of series, 678 
vector, 534 
vector triple, 541 

Quadratic form,'466 
indefinite, 467 
kinetic energy, 503 
matrix of, 467 
negative, 466 
negative-definite, 466 
conditions for, 468 
nonsingular, 467 

polar of pomt with respect to, 470 
positive, 466 
positive-definite, 466 
conditions for, 468 
potential energy, 476e , 503 
reduction of, to sum of squares, 471 
semidefinite, 466 
singular, 467 
Quality factor, 17le. 



Radius, of convergence, 347, 689 
of curvature, 548 
Rank, 437 
column, 456 
determinant, 437 
row, 456 

of tensor, 620, 621 
Ratio test, 676 
Reactance, 169 
Region, 646 
boundary point of, 646 
bounded, 646 
closed, 646 
exterior point of, 646 
interior point of, 646 
multiply connected, 582 
open, 646 

simply connected, 582 
unbounded, 646 
Regular function, 653 
piecewise, 226 
Regular point, 653 
Residue theorem, 701 
Residues, 700 
calculation of, 702 

evaluation of definite integrals by, 704 
708 

Resonance, 2 
with higher harmonics, 202 
Rodrigues’ formula, 392 
Root-coefficient relations, 719, 757 
Routh-Hurwitz stability criterion, 721 
Running integral, 105 

Scalar, 418, 532 
Scalar product, 418, 534 
Scalar triple product, 538 
Schmidt orthogonalization process, 458, 470 
Schwarz-Christoffel transformation, 748 
Self-conjugate form of equation of circle, 
636e , 738 

Separable differential equation, 8 
Separation of variables, m first-order differ¬ 
ential equations, 8 
m partial differential equations, 302 
Sequence of matrices, convergence of, 525 
divergent, 525 
Series, addition of, 678 

of Bessel functions, 375, 380, 385 
convergence of {aee Convergence) 
differentiation of, 684, 685 
Fourier {see Fourier series) 
integration of, 683 
Laurent’s, 692 

of Legendre polynomials, 398 
Maclaurm’s, 689 
of matrices, 528 


Series, multiplication of, 678 
of orthogonal functions, 318 
partial sums of, 676 
power, 689 

rearrangement of terms of, 677 
region of convergence of. 676 
remainder after n terms of, 676 
sum of, 676 

continuity of, 682 
summation of finite, 88, 89e 
Taylor’s, 687 

circle of convergence ol, 688 
radius of convergence of, 689 
Set of vectors^ dimension of, 456 
orthonormal, 458 

Schmidt orthogonalization process for, 
458, 470 

Shaft vibrations, longitudinal, 293c. 

torsional. 302 
Shear, 56 

relation of, to bending moment, 57 
Similarity transformation, 443 
Simple closed curve, 568n 
Simply connected set, 646 
Simpson’s rule, 107c 
Simultaneous algebraic equations, 447 
consistency of, 450 
Gauss’ reduction for, 449 
homogeneous, 447 

condition for nontrivial solution of, 

454 

solution vectors of, 418, 447 
nonhomogeneous, 447 

augmented matrix of, 447 
solution of, by Cramer’s rule, 453 
Simultaneous differential equations, 66, 461 
characteristic equation of, 75, 462 
complementary function for, 76, 463 
complete solution of, 76, 403 
m matrix form, 461 
particular integral of, 76, 465 
reduction to single equation, 67 
Sine integral function, 218 
Sine transform, 236 

Singular point, of analytic function, 653 
essential, 699 
isolated, 699 

of differential equation, 346 
irregular, 346 
regular, 346 
residue at, 700 
Singularity functions, 277 
Specific heat, 189 
Spherical coordinates, 389 

differential of arc length in, 615 
Spherical harmonic, 389 
Spring modulus, 59 
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Square matrix, 415 

characteristic equation of, 477 
characteristic values of, 477 
characteristic vectors of, 477 
integral powers of, 505 
minimum polynomial of, 521 
polynomial annihilator of, 521 
polynomial equations in, 513 
polynomial functions of, 506 
characteristic vectors of, 510 
power series in, 528 
rational functions of, 508 
characteristic values of, 510 
trace of, 479 
(See also Matrix, square) 

Stability criteria, 716 
for cubic equations, 719 
Nyquist, 726 
Uouth-Hurwitz, 721 
Static deflection, 157 
Steady state, 160 
Stefan’s law, 312 
Stiffness matrix, 434 
Stirling’s interpolation formula, 97 
Stoke’s theorem, 577-579 
Stream lines from channel, 752 
String, forced vibrations of, 329 
traveling uaves on, 296, 298, 3 19 
vibration of, 283, 379 
St-urm-Liouville theorem, 320 

extension to fourth-order systems, 322 
Submatrices, 416 

Summation of finite scries, 88, 89c 
Surface harmonic, 390 
Susceptance, 169 

Systems, ^\^th one degree of freedom, 145 
with several degrees of freedom, 145, 171 
use of difference equations in, 123, 174 


Tangential acceleration, 548 
Taylor’s senes, 687 

use of, in least squares, 137 
Taylor’s theorem, 686 
Telegraph equations, 292 
Telephone equations, 292 
Tensor, alternating, 621 
or arbitrary rank, 621 
components of, 620 
contraction of, 622 
contravanant, of rank 1, 620 
of rark 2, 620 
covariant, of rank 1, 620 
of rank 2, 620 

CO variant derivative of, 631, 632 
fundamental metric, 621 
mixed, of rank 2, 621 
of ^nk sere, 620 


Tensor, skew-symmetric, 621 
symmetric, 621 
Tensors, equal, 621 
inner product of, 622 
outer product of, 621 
quotient law for, 623 
sum of, 621 

Theorem, binomial, 695 
Cauchy-Goursat, 668 
Cauchy’s, 667 
de Moivre’s, 639 
divergence, 572 
Euler’s, 14 
Gauss’, 577, 585c 
Green’s, 575 
Heaviside's, 255 
Lerch’s, 24471 
Liouville’s, 691 
maximum modulus, 674 
Morera’a, 672 
Parseval’s, 318 
residue, 701 
Stoke’s, 577-579 
Sturm-Liouville, 320 
extended, 622 
Taylor's, 686 

Theory of distributions, 278n 
Thermal conductivity, 289 
Torricelli’s law, 23 
Torsion of space curve, 550c 
Torsional rigidity, 286 
Total differential, 3 4, 552 
Trajectories, orthogonal, 28c , 655 
Transfer function, 273, 727 
Ti ansformations of matrices, 443 
Transforms, cosine, 236c 
Fourier, 22le 

Laplace (see Laplace transfoims) 
sine, 236c 

(See also Fourier transform pair) 
Transient, 159 

Transition probabilities, matrix of, 426 
Transmission line, equations for, 291 
steady-state behavior of, 332 
transient behavior of, 342 
Trapezoidal rule, 105 

use of, m running integration, 105 
Trigonometric functions of complex vari¬ 
ables, 659, 662 
Trivial solution, 454 


Umbral index, 610 

Undetermined coefficients, method of, 43, 
121 

Uniform convergence, of infinite integrals, 
228 

of infinite series, 678 
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Uniform cronvergence, of Laplace transform 
integral, 231 

Unilateral Fourier translonn pair, 222 

Unit doublet, 277 

Unit impulse, 276 

Unit step function, 237 

Unit triplet, 278 

Unit vectors, 419, 533 

Unitary transformations, 443 


A'anation of parameters, 49 
Vector, 417, 532 
abdoliite value of, 418, 532 
components of, 418 
curl of, 554 
divergence of, 554 
lengtli of, 418 
generalized, 470 
negative of, 533 
product of scalar and, 533 
unit, 419, 533 
zero, 533 

Vector acceleration, 548 
Vector angular velocity, 555 
Vector functions, 545 
derivative of, 545 
differentia f, 545 
line integral of, 560 
surface integral of, 565 
Vector moment, 545e 
Vector product, 534 
Vector triple product, 541 
Vector velocity, 548 
Vectors, addition of, 533 
characteristic, of square matrix, 478 
contravariant representation of, 603 
covariant representation of, 603 
cross product of, 534 


Vectors, difference of, 5'.i3 
dot product of, 418, 534 
equal, 533 

inner product of, 418, 534 
normalized, 470 
orthogonal, 410 
orthonormal, 458 
reciprocal sets of, 544c , 599 
m same direction, 419 
scalar product of, 534 
solution, 418, 447, 477 

orthogonality of, 484, 488, 500 
Velocity smoothing, 134, 142c 
Vibrations, a'.iplitude modulation of, 162 
of beams, 287, 323 
damped, 153 

of electric circuits, 165, 174 
fotced («ec Forced vibrations) 
fiee {see Free vibrations) 
of membranes, 284 
norm 111 modes of, 326, 501 
of shafts, 285, 302 
of strings, 282, 298, 329, 379 
Volume mtegral, 566 


Wove equation, one-dimensioiial, 284 
D’Alembert solution of, 295 
two-dimensional, 285 
Wcierstrass M test, 681 
Work, 563 
Wronskian, 31, 52/i 


Zeros, of Bessel functions, 353, 356, 357c., 
359 

within given contour, 722 
Zonal harmonic, 392 







